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ABSTRACT 

The objective of this research has been to characterize 
in terms of spectral representations and interval distribu- 
tions the univariate point process resulting from the super 
position of a finite number of independent, identically 
distributed renewal processes with either Erlang or hyper- 
exponential interval distributions. A corollary to the 
direct line of inquiry has involved a broad class of uni- 
variate point processes known as semi-Markov generated 
point processes . A semi-Markov generated point process 
may be thought of as a superposition of dependent renewal 
processes. The spectral and distributional characteristics 
are developed for such processes with finite state space, 
and the superposition of renewal processes with Erlang or 
hyperexponential interval distributions is shown to have an 
equivalent representation as a semi-Markov generated point 
process. Equivalence here refers to the probabalistic 
structure of the time between events, and more specifically 
the spectral properties. 
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I. INTRODUCTION 



This thesis is concerned with the analysis and proba- 
bilistic properties of point processes which arise from 
superposing a finite number of renewal processes. Most 
previous work in this field has considered the case where 
the number of superposed processes is very large. 

The concept of point process is quite general. A point 
process is a countable set of primitive events defined on 
a continuum. That is, given a vector space, a point process 
is any set of vectors defined on the space. The research 
recorded in this dissertation deals with a specific class 
of point processes defined on the non-negative real line, 
(sometimes called a series or stream of events). Moreover, 
they are univariate point processes or series of events in 
that events are distinguishable only by where they occur 
on the real line. 

Point processes arise naturally in a wide variety of 
situations, both deterministic and stochastic in nature. 

For example, the location of the stars in the universe 
relative to the earth coordinate and time system is a 
deterministic point process, while the time, location and 
magnitude of earthquakes on the surface of the earth may 
be considered a stochastic point process. 

The analysis of a point process is highly dependent 
upon the nature of the process and the questions to be 






answered. For this reason, point processes have been 
classified into groups within which similar analytic 
methodology may be applied. 

Section A contains a discussion of some of the various 
classifications of point processes, with examples, followed 
in Section B by a description of those particular point 
processes which are the subject of this research. 

The scope and limitations of the research are delineated 
in Sections C and D, with a general overview of the thesis 
presented in Section E. Some of the more significant 
results are detailed in Section F. 

A summary of previous work relevant to this project 
is presented in Chapter II. 

I. A. CLASSIFICATION OF POINT PROCESSES 

Recall that a point process is a set of primitive events 
defined on a vector space. Restricting attention to those 
processes v/hich are stochastic in nature, classification 
is based on the dimension of the vector space and the des- 
criptive properties associated with the primitive events. 

The following subsections describe some fairly general 
classes of point processes. The names given for the 
classes, while not universally accepted, are commonly used 
(See Lewis, 1972, for further discussion). 

I.A.l. The Multidimensional Point Process 

The multidimensional point process is a set of 
events defined on a multidimensional vector space. Typically, 
although not exclusively, the dimensions are those of space. 



15 



An example of such a process might be the list of 
submarine sinkings in World War II recorded by location. 

That is, each element of the point process is identified by 
latitude and longitude only. 

I. A. 2. The Multivariate Point Process 

A multivariate point process is one for which, in 
addition to its location in a vector space, the events are 
distinguishable by some other qualitative factor. In the 
above example of submarine sinkings, to each location vector 
might be appended the parent alliance (Allied or Axis) of 
the lost submarine. This process would now be classified 
as a two dimensional bivariate point process. 

I . A . 3 • The Marked Point Process 

A marked point process is one for which the events 
have quantitative information associated with each event. 

An obvious example is that of a record of earthquakes which, 
in addition to the time coordinate, each event has an 
associated energy level and location vector. 

An example of a univariate, unidimensional, marked 
point process which is easy to visualize is that of arrivals 
at a supermarket checkout center. The vector space is the 
positive time line, while the mark is the value of purchases. 

I. A. 4. Classification by Event Source or Structure 

In addition to the above classification list, point 
processes are categorized by special characteristics of the 
source of the events, or structure of the process. The 
definitions are not precise, and some processes may fall in 
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more than one category. No attempt, will be made here to 
name all the possible categories, but some examples will 
clarify the idea. 

A cluster process is one in which some events are 
generated by a main or driving process, while other events 
are in some way triggered by the main events (Lewis, 1964; 
Vere-Jones, 1970). An example of a cluster process, also 
known as a branching point process, is the sequence of 
landing times aboard an aircraft carrier. If several air- 
craft are assigned a joint mission, the arrival of the first 
aircraft of the group might be considered the main event, 
with the arrival times of the remaining members of the 
group being subsidiary events. 

Another classification of point processes according 
to event source is the superposition of point processes 
(Cox and Smith, 1954; Cox and Lewis, 1966, Ch. 8; Cinlar, 
1972). Under this formulation, the observed events of a 
point process may have originated in any one of several dis- 
tinct point processes, but with no indication of which 
process was the source. This form of point process is the 
subject of this research, and is explained in more detail 
below . 

A third category is the renewal process to be 
defined in the next section. 

I.B. THE SUPERPOSITION OF RENEWAL POINT PROCESSES 

Much of the analysis of point processes is directed 
toward determining the underlying probabilistic structure 
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of a point process based on information gained from a 
statistical sample, or conversely, determining the statis- 
tical properties of a sample from assumptions regarding 
the underlying structure. 

A univariate point process which has been the object 

of extensive study is the renewal process. A renewal process 

is a univariate point process defined on the non-negative 

real line for which the separations between adjacent events 

are independent, identically distributed random variables. 

It is convenient when discussing unidimensional processes 

to refer to the events as occurrences in time, and to index 

the events accordingly. Thus, given events = t^ and 

E. = t., where the indices i and j are taken from the set of 
J J 

integers, and the times are measured from some arbitrary 

origin, then t. < t. whenever i < j. 
i J 

If several independent renewal point processes are 
operating concurrently, then the union or pooling of the 
events of all the processes, without regard to which process 
generated a particular event, forms a superposition of 
renewal point processes which is itself a univariate point 
process. Figure I.B.l shows graphically the superposition 
of two univariate renewal point processes. The processes 
which contribute events to the superposition process are 
called the component processes. 

While in the general definition of superposition it is 
not necessary that the component processes be renewal 



18 



compone nt 
process j 

i 

I 

superposit ion j 



conponer^t, 

process 



T 

I 

I 

I 

I 



I 

I 

l 

l 



I 

I 

I 



4 - 




Figure I.B.l. Superposed output of two renewal point 
processes. This illustrates the basic idea of a super- 
position process. Intervals in the component processes 
are independent. In general, the intervals of the 
superposition process are related. 
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processes, in this thesis the primary interest is in super- 
position of independent renewal processes. However, in 
studying these consideration is given to multivariate or 
multitype processes called semi-Markov processes; the com- 
ponent processes are dependent renewal processes and their 
superposition is called a semi-Markov generated point process 

Some examples will clarify the concept and indicate the 
broad applicability of the superposition model to point 
processes which occur naturally in science and technology. 

Example I.B.l: Nerve fiber pulses. Cox and Smith 

(195*0, Cox (1962) and Cox and Lewis (1966) explore the 
hypothesis that the electrical impulses observed in a neuron 
are responses to stimulus from several independent sources. 
Under some distributional assumptions regarding the component 
processes, including the assumption that they are independent 
a method was developed to estimate the number of processes 
generating impulses in the observed neuron. The methods are 
very ad hoc and hopefully the results of this thesis will 
lead to improved methods of analysis. 

Example I.B.2: Failure patterns of series systems . 

In reliability theory, a series system is taken to be a 
piece of equipment which is made up of a combination of 
component parts such that each component must function in 
order for the system to function. Thus the system fails 
each time a component fails. If each component failure 
results in replacement of that component with a component 
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having the same failure time distribution as the original, 
the sequence of system failure times is a univariate super- 
position process. Lewis (1964) and later Downton (1972) 
examined this structure with regard to the nature of the 
stationary failure process as the number of the components 
grows large . 

Example I.B.3’ Resupply of a remote activity . An 
activity at great distance from a logistics center is 
resupplied by a fleet of vehicles which traverse a fixed 
route. Assuming that the successive round trip transit 
times for each vehicle may be treated as a renewal process, 
the arrival pattern of the entire fleet may be represented 
by a univariate superposition process. Barnett (1970) 
studied this problem in order to characterize the time 
between arrivals. 

Example I.B.4: demand for gas turbine engines for DD 

963 class destroy ers . A class of new U. S. Navy destroyers 
will each be equipped with four gas turbine main propulsion 
engines. Each time an engine fails or has been operated for 
a specified time, it must be replaced. The sequence of 
replacements associated with a particular engine position 
may be taken to be a renewal process. The demand for engines 
emanating from all engine positions on all ships is a uni- 
variate superposition of renewal processes. This demand 
pattern is of interest to planners who must arrange for 
procurement and repair of the gas turbine engines. 
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Example I.B.5: Highway traffic analysis. Automobiles 

passing a checkpoint on a multilane highway form a super- 
position process. If a counter is placed so that it records 
the passage of cars in all lanes, and the stream of cars 
in each lane is taken to be a point process, the record of 
the counter is that of a superposition process. In this 
example, the component processes may be distinctly non- 
Poisson, non-independent and perhaps non-stationary , 
indicating the broad applicability of the superposition 
process . 

I.C. RESEARCH OBJECTIVES 

The objective of this research has been to characterize 
in terms of spectral representations and interval distribu- 
tions the univariate point process resulting from the super- 
position of a finite number of independent, identically 
distributed renewal processes with either Erlang or hyper- 
exponential interval distributions. The ultimate goals 
were to provide the methodology by which a given set of data 
from a univariate point process might be modeled as the 
superposition of a finite number of Erlang or hyperexponentia 
renewal processes, the determination of the number of pro- 
cesses superposed being a key question, or to provide means 
of predicting the behavior of a superposition process based 
on assumptions regarding the finite number of independent 
component renewal processes. 

A corollary to the direct line of inquiry has involved 
a broad class of univariate point processes known as 
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semi-Markov generated point processes . A semi-Markov process 



may be thought of as a sequence of Independent, non-negative 
random variables sampled in accordance with a Markov chain. 
If the sequence of times between transitions are taken as 
interevent times in a univariate point process, a semi- 
Markov generated point process has been defined. This is 
the same as the process given in Cox and Lewis ( 1966 , 
pp . 19*0 for which the analysis of a two state process is 
presented. The spectral and distributional characteristics 
are developed for such processes with finite state space, 
and the superposition of renewal processes with Erlang or 
hyperexponential interval distributions is shown to have an 
equivalent representation as a semi-Markov generated point 
process. Equivalence here refers to the probabilistic 
structure of the time between events, and more specifically, 
the spectral properties. 

While a prediction scheme for future behavior of the 
superposition process based on historical knowledge of the 
process is not one of the objectives of this work, most 
practical schemes for prediction have been based on the 
second order spectral properties which are presented here . 
See, for instance, Yaglorn (1962) or more recently Jowett 
and Vere-Jones (1972). In this line it should be pointed 
out that a crucial difference between classical time series 
(sequences of random variables) and intervals between 
events in a point process is that the former are almost 
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always assumed to be normally distributed, while the inter- 
vals in a point process are positive random variables and 
very non-normal. 

I.D. RESEARCH LIMITATIONS 

In addition to the fact, mentioned above, that the 
prediction problem has not been examined, other interesting 
and relevant topics have not been considered. While a major 
motivation behind the study of superpositions has been 
estimation of the number of component processes (see Cox 
and Lewis, 1966, Ch. 8), no effort has been made here to 
address this problem directly. 

The subject of data analysis with regard to spectral 
and bispectral estimation (see for example Tukey, 1959, and 
Brillinger and Rosenblatt, 1967) is an important area which 
complements the current research, but is not included. 

In reliability, the failure pattern of a series system 
may be modeled as a superposition of renewal processes 
(Example I.B.2). It might be conjectured that a much broader 
range of system designs may be modeled as semi-Markov genera- 
ted point processes. In view of the results reported in 
Chapter V, research in this area might provide an important 
contribution to reliability theory. It is hoped that the 
results presented in this thesis will provide the basis 
for future research along some of the above avenues. 
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I.E. GENERAL OVERVIEW 



This dissertation can be roughly divided into four 
parts. The first part is direct spectral analysis of the 
hyperexponential and Erlang superpositions (that is, super- 
positions of independent, identically distributed renewal 
point processes with either Erlang or hyperexponential 
interval distributions) . Following is an analysis of the 
spectral and distributional properties of a semi-Markov 
generated point process, and the semi-Markov generated 
point process representations of the Erlang and hyperexpo- 
nential superpositions. 

The third part of the thesis involves study of the 
marginal interval density of the superposition of renewal 
processes. - Finally, the formulations of the first three 
parts are developed computationally. 

Chapter II contains a summary of definitions, notation 
and basic results- regarding point processes in general 
which have application to this research project. Also in 
Chapter II will be found a brief summary of some of the 
known properties of superposition processes. 

Chapter III contains a detailed development of the 
second order spectral representation of the Erlang super- 
position process based on the work of Cox and Lewis ( 1966 ) 
and Lewis, et al ( 1973 )- Some qualitative results are 
established regarding the second order interval spectrum, 
and a relationship with the second order spectrum of a 



mixed autoregressive/moving average process is given. An 
expression is derived for the second order spectrum of 
counts, relating it to the count spectrum of a component 
process, and the number of components. Some specific 
Erlang superpositions are examined in detail. 

Chapter IV examines the hyperexponential superposition 
in much the same way. The development is constrained by 
the unlimited number of parameters in a general hyper- 
exponential distribution. A two parameter model is studied 
in detail. 

The semi-Markov generated point process is defined and 
analyzed in Chapter V. This process has been used by Lewis 
and Shedler ( 1973 ) to model page exception processes in 
multiprogrammed computers. The work of Rudemo ( 1973 ) with 
regard to second order count spectra of semi-Markov generated 
point processes is summarized. Joint distributions of inter- 
vals, serial covariances and higher order Joint moments are 
derived for this process. The second order spectrum of 
intervals and the interval bispectrum are shown to be func- 
tions of the Markov transition matrix and the marginal 
moments of the process. A method is indicated for obtaining 
higher order interval spectra of the semi-Markov generated 
point process. 

In Chapter VI, the "method of stages" is used to model 
hyperexponential and Erlang superposition processes as 
equivalent semi-Markov generated point processes. It must 
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again be stressed that equivalence refers to probabilistic 
structure, and not physical structure. A state of the 
Markov chain cannot be related to a particular component 
process, but rather contains information regarding the 
overall superposition process. The concept of lumpability 
is employed to reduce the state space associated with the 
superposition process to a workable size. 

In Chapter VII the marginal probability density function 
of an interval in a process formed by superposing independent 
renewal processes Is shown to be a function of the survivor 
functions of the component renewal processes, following the 
development of Cox and Smith ( 195 * 0 . The relationship between 
the number of processes superposed and the initial value of 
the marginal probability density function of a superposition 
interval is shown to have a simple and useful relationship 
to the number of component processes. The results derived 
for the superposition of general renewal processes are 
applied to the Erlang and hyperexponential superpositions. 

Numerical testing and tabulation of the results of 
Chapters III through VII are found in Chapter VIII . A 
computer oriented discussion covers such diverse topics as 
the Fast Fourier Transform, and algebraic manipulation com- 
pilers such as FORMAC . Alternative methods of solving the 
various problems are suggested and evaluated quantitatively 
with regard to response to particular questions and computer 
efficiency. Several graphs and tables are presented to 
enable comparison of the various processes, and to indicate 
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the type of information available from this type of analy- 
sis. Included among the graphic displays are second order 
count and interval spectra, marginal densities, and bispectral 
representations . 

I . E . 1 . Thesis Organization 

Chapters are numbered with Roman numerals, with 
major sections designated by capital letters. Subsections 
are indexed within the major sections by Arabic numerals, 
with further subdivision marked with lower case letters. 

Thus Subsection III. A. 2 is found within Section A of 
Chapter III. 

Theorems, lemmas and examples are numbered sequen- 
tially within chapter sections. For example. Theorem III. A. 5 
is the fifth Theorem of Section III. A. Equations are num- 
bered sequentially within sections and subsections, with 
chapter reference in Arabic numerals, and enclosed in paren- 
theses. Equation (3. A. 2. 12) is the twelfth numbered 
formula in Subsection III. A. 2. 

The designation of figures follows that of the 
theorems. That is. Figure V.A.l is first referenced in 
Chapter V, Section A. 

Appendices follow Chapter VIII and are designated 
by upper case letters. 

I.F. SIGNIFICANT RESULTS 

Despite the natural occurrence of superposition pro- 
cesses, there are few analytical results for finite 
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superpositions (see Cinlar, 1972). In order to fill this 
gap, this research has concentrated on the study of super- 
positions of renewal processes having either Erlang or 
hyperexponential distributions. These particular distribu- 
tions were chosen because they are reasonably tractable from 
a computational viewpoint, and they are sufficiently flexi- 
ble in parameterization that in many cases, empirical data 
appears to fit one of the two forms . 

Several interesting results have been established during 
the course of this research which may prove valuable to 
statisticians working with superposition processes. 

I . F . 1 . Spectrum of Intervals and the Relationship of 

the Superposition Process to a Stationary Mixed 
Autoregressive/moving Average Process 

A mixed autoregressive/moving average process of 
orders m and n (ARMA (m,n) process) is a sequence of random 
variables, { Z } , each element of which is equal to a linear 
combination of the n previous elements of the sequence plus 
a linear combination of m corresponding random shocks, where 
the shocks are independent and identically distributed with 
zero mean and finite variance. A large body of knowledge 
is available regarding this type of process with respect 
to identification of the numbers m and n, and estimating 
the linear coefficients of the model. The major portion of 
these procedures are based on the serial correlation struc- 
ture, or equivalently the second order spectral structure 
of the process. See for example Box and Jenkins (1970). 
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A superposition process is not a mixed autoregressive/ 
moving average process, nor can it be modeled as one because 
of the non-negativity of the time between events. However, 
the second order spectral structure of the intervals of 
the Erlang and hyperexponential superposition processes is 
the same as that of a mixed autoregressive/moving average 
process, opening up much of the time series methodology 
for application to this class of stochastic processes. 

This fact is stated as Theorem III. A. 2 with proof in 
Chapter VI . 

When a superposition process and an ARM A process 
have identical second order spectral properties, the 
processes will be called similar . 

I. P.2. The Order of a Similar ARMA Process 

With the establishment of the fact that certain 
types of superposition processes have similar ARMA pro- 
cesses, it was necessary to determine the relationship in 
detail. Given a sequence of serial correlation coefficients 
which may be attributed to an ARMA(m,n) process, what can 
be said about the similar superposition process? 

This question was addressed in Chapter III from the 
inverse point of view. For specific superposition processes, 
the order of the similar ARMA process was determined. For 
a class of superposition processes, upper bounds on the ARMA 
order were specified. In those cases where a final algebraic 
form for the interval spectrum was determined, the upper 
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bounds were achieved. However, there is evidence that this 
will not always be the case. 

I. P.3. The Structure of a Semi-Markov Generated Point 
Process 

2 

The semi-Markov process may be thought of as n 
independent, non-negative random variables sampled in accor- 
dance with a Markov chain. If the sequence of times between 
samplings is taken to be the time between events in a point 
process, a semi -Markov generated point process has been 
formed . 

The joint structure of intervals in a stationary 

semi-Markov generated point process is shown in Chapter V 

to be an easily obtained function of the transition matrix 
2 

and the n random variables. 

Although this formulation has value in its own 
right, its applicability to this research lies in the fact, 
demonstrated in Chapter VI, that the classes of superposi- 
tion processes under study have equivalent representations 
as semi-Markov generated point processes. That is, the 
univariate point process generated by either the semi- 
Markov process, or the superposition process have identical 
probabilistic structure. Thus, in a reasonably direct 
way, the spectral structure of all such processes may be 
determined . 

I.F.lJ. The Inverse of a Characteristic Matrix 

In Section 3 it was stated that the spectral repre- 
sentation of the Intervals between events In a semi-Markov 
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generated point process was an easily obtained function 
of the transition matrix. In fact, the spectrum is a linear 
combination of terms of the form (Ix-T)~\ where this term 
must be evaluated for all (complex) values of x for which 
the inverse exists. In Chapter VIII this problem is 
addressed and three methods of solution are proposed, 
tested and compared. 
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II. PRELIMINARY CONCEPTS AND RESULTS 



The objective of this chapter is to establish the foun- 
dation upon which this research has been based. The work 
of Cox and Lewis (1966) provided much of the point process 
technology, some of which has been expanded here to charac- 
terize certain superposition processes. Where practicable, 
the notation of Cox and Lewis has been adopted. 

Section A contains definitions and notation, along with 
the development of some basic results, with regard first to 
the general stationary, univariate, unideimensional point 
processes, then for the superposition of renewal point 
processes. Finally, the special notation peculiar to the 
particular class of processes under investigation is intro- 
duced. Appendix A summarizes the notation found throughout 
'the thesis. 

Section B contains a brief summary of known results con- 
cerning the superposition of point processes which are of 
interest in the context of this research. 

II. A. PRELIMINARY NOTATION, NOMENCLATURE AND DEFINITIONS 

Tw o distinct avenues of research are represented in this 
thesis. The primary field is that of the superposition of 
independent renewal processes. A second class of processes 
considered are those (univariate) processes generated by 
the transitions of a semi-Markov process . These univariate 
point processes are called scml-Marko v generated point 
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processes . The interest in this second class of processes 
stems from certain distributional properties of the hyper- 
exponential and Erlang component processes of a superposition 
which permit the construction of a semi-Markov generated 
point process equivalent to the superposition of independent 
renewal processes. The term "equivalent process" means that 
the probabilistic structure of the point processes generated 
by either method is the same. It must not be inferred that 
superpositions of general renewal processes have equivalent 
semi-Markov generated point processes, nor that every semi- 
Markov generated point process is equivalent to a superposition 
process . 

While much of the notation and many basic definitions 
are introduced throughout this thesis, particularly with 
regard to the semi-Markov process, some will be presented 
here which are of a general nature. 

II. A. 1. The Point Process 

Prom here forward, unless otherwise specifically 
stated, the phrase point process will refer to a stochastic, 
unidimensional, univariate, regular series of events. That 
is to say, the events are defined on the non-negative real 
line, and are distinguishable only by their location on the 
line. The regularity condition (Daley and Vere-Jone, 1972, 
Sect. 6) requires that the probability of more than one 
event in an incremental interval, h, is o(h), where the 
limit as h tends to zero of o(h)/h is zero. A point process 
is completely count stationary if the finite dimensional 
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distributions of counts of events in finite Intervals are 
invariant under translation. (See Cox and Lewis, 1966, 

Ch. 4.) 

A point process has four representations which are 
physically equivalent in the sense that knowledge of one 
representation is equivalent to knowledge of the others, 
although the translation from one representation to another 
is not necessarily simple. The representations will be 
referred to as the asynchronous count and interval processes 
and the synchronous count and interval processes. 

Let (X n ) be a sequence of iid (independent, iden- 
tically distributed) non-negative random variables. The 
sequence (X n > Is, by definition, stationary since the finite 
dimensional distributions 



Pr[X^ x j 3 Pr [X^ + ^ ^ x^,..., Xj x ^ j 



(2. A. 1.1) 



for all finite sets of indices {i,...,j}, and all real valued 
vectors (x^,...,Xj). In a renewal theory context (X n ) is 
called an ordinary renewal interval p rocess . In general, if 
(X^) is a stationary sequence of non-negative random varia- 
bles giving the times between events in a point process, it 
will be referred to as the synchronous interval process for 
the point process. The meaning of the word "synchronous" 
will become clear in the discussion of arbitrary events, 
below . 
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Directly related to the synchronous interval process 



is the synchronous counting process , N^(t ) , which gives the 
number of events in the interval (o,t], where o is the event 
time at which the interval x^ commences. In general N^(t) 
is not a process with stationary increments. 



selecting an event to start the counting process which are 
beyond the scope of this thesis. (See Daley, Vere-Jones, 
1972, for more on the Palm-Khinchine theory.) 

To define the asynchronous counting process asso- 
ciated with the point process, let the number of events 
which occur in the interval (t,t+u) be given by N(t,t+u). 
Assume that t was chosen independently of the stationary 
interval sequence {X n >. Then it can be shown that for any 
real value h. 



This stationary property can be extended and expressed as 



There are subtleties connected w r ith the idea of 



Pr [N( t+h , t+h+u) = n] = Pr[N(t ,t+u) = n]. 



Pr[N(t 1 ,t^) = r\ 1 




Pr [N ( t,+h , t^+h ) = n^ 



N(t k +h,tjM-h) = n k ] 

(2. A. 1.2) 






and for all 



for any set of k finite intervals, k = 1 , 2 ,..., 

real h. Thus, N(t,t+u), representing the number of events 

in an interval of length u from an arbitrary origin, is the 

asynchronous counting process and will be denoted N(u). 

Stationarity of a point process usually is taken to mean 

that N(t,t+u) is a process w T ith stationary increments. 

The asynchronous interval process is intimately 

connected to the asynchronous counting process . Again, 

taking the basic process to be the synchronous interval 

sequence {X^}, then the arbitrary origin of the asynchronous 

counting process, N(u), will fall in some interval, say 

X! . The time forward from the arbitrary time of the origin 
J 

until the next event in the process, denoted W, is governed 
by the forward recurrence time distribution (Lawrance, 1970) 



Pr [V/ <_ x] = Fy ( x ) = y 



-1 



/ R x (u)du, 



where R^Cu) is the marginal survivor function for an element 
X of the sequence {X^}, and y = E[X]. 

Including successive intervals , the resulting 
sequence {VJ,X! , , ,X! . OJ . . . } = {W,L n ,L_ , . . . } is called the 

3 Id 

asynchronous interval process . In general, the asynchronous 
interval process is not stationary with respect to the index 
sequence. The main idea here is that the sampling, performed 
by choosing an asynchronous origin, picks out an interval 
Xj which is length-biased (Cox and Lewis, 1966, Ch . 4) and 
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doesn't have the same distribution as the intervals (X n ). 
Moreover the effect persists to successive intervals, e.g. 

x j + i- 

The following expressions will clarify the 
relationship of the various representations: 

N(t) < n<t=>¥+L +...+L x > t, n = 1,2,..., (2. A. 1.3) 

N f (t) < n<=>X 1 +X 2 +...+ X > t, n = 1,2, (2. A. 1.4) 

An arbitrary event is most easily explained in 
terms of the asynchronous counting process. Consider the 
number of events in an interval of length u following an 
arbitrary event. This may be defined as (Khintchine, I960) 

Pr[N f ,(u)=n] = lim Pr [N ( t+h, t+h+u)=n | N(t,t+h)^l] (2. A. 1.5) 

1 h+0+ 

* 

Equivalently, the interval following an arbitrary event is 
X^ of the stationary interval process, with the index 
origin chosen arbitrarily. The word "synchronous" refers 
to synchronization with an arbitrary event. 

The interval following an arbitrary event will be 
referred to as an arbitrary interval . 

If one ignores the complication caused by the start 
(asynchronous or synchronous) of the process, it may be 
observed from (2. A. 1.3) and (2. A. 1.4) that there are two 
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stationary stochastic processes, N(t) and {X n ), which can 
represent the process. Consequently, there are two (partly 
related) second order analyses possible: that of the count 

process, N(t), and that of the interval process, (X n ). Both 
are useful, the relative utility depending on the process 
examined. We note that analysis based on N(t) is more 
fundamental, mainly because data often comes aggregated 
(as the number of events in a day, for example) without 
exact times of events. In addition it reflects phenomena 
in continuous time. However, phenomena which are reflected 
in serial number will be more marked in the interval 
properties . 

Cox and Lewis (1966, Ch. ) , develop several pro- 
perties associated with point processes. The following 
two subsections contain a summary of the pertinent portions 
of that development. 

II. A. 2. Properties and Characterizations of the 
Counting Process 

Of interest with respect to the counting representa- 
tions are the mean-time curves, M(t) and M^(t), for the 
synchronous and asynchronous counting processes, respectively, 
and their intensity functions, m(t) and m^(t). Also the 
covariance density function y(t), the variance-time curve, 
V(t), and the second order spectrum of counts for the 
stationary counting process. 
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Beginning with the asynchronous counting process, 



M(t ) = E [N ( t ) ] (2. A. 2.1) 

is the expected number of events in an interval of length 
t with arbitrary origin. The stationarity of N(t) leads 
to 



M(t) = t/y , ' (2. A. 2. 2) 

where y is the expectation of an arbitrary interval. The 
variance-time curve is defined in a natural way for the 
asynchronous process: 

V(t) = E[N 2 (t)] - E[N(t)] 2 . (2.A.2.3) 

The mean-time curve of the synchronous counting 
process is, using the relation (2.A.1.JJ), 

00 

M f (t) = E [N f ( t ) ] = S Pr[N f (t)>r] 

r=l 

oo 

= E F ( t ) , (2. A. 2.4) 

r=l r 

where F^Ct) = PrCX^ + ...+ X^<_t ] , taking {X^} to be the 
synchronous interval sequence. 

The intensity function of a counting process is 
m(t) - d/dt{M(t)} or m^(t) = d/dt {M^( t ) } , where m(t)dt may 



be thought of as the probability of an event in the 
infinitesimal interval (t,t+dt). Thus 

m(t) = y _1 = m, (2. A. 2. 5) 

and, when the derivative exists, from (2. A. 2. 4) 

oo 

m„(t) = Z f (t), (2. A. 2. 6) 

1 r=l r 

where f (t) is the pdf (probability density function) 
associated with F (t). 

To develop the covariance function, let dN(t) 
denote the number of events in an increment of time. That 
is. 



dN(t) = N ( t+dt ) - N(t) . 

* 

Then, if the process is assumed to be regular, 

E[dN(t)] = E[(dN(t)) 2 ] = md + o(dt) (2. A. 2. 7) 

and, since (E[dN(t)]) 2 = o(dt), 

Var(dM(t)) = mdt+o(dt). (2.A.2.8) 



Looking now at the joint expectation, for t > 0 



E[dN(t)dN(t+xJ ] = Pr[dN(t)=dN(t+x)=l] + o(dt 2 ) 



= mdt PR[dM(t+r)=l dN(t)=l] + o(dt 2 ) 

= mm f (t)dt 2 + o(dt 2 ) . (2. A. 2. 9) 

Now define the covariance density as 

Y,(x) = lim E[(dM(t)-mdt) (dN(t+T)-m r (T)dt)l/dt 2 
dt+0 1 

= lim [m(m f (x)-m) + o(dt)] 
dt->-0 

= m{m^.(x)-m} . (2. A. 2. 10) 

Maintaining consistency with (2. A. 2. 8) and observing 
that from the stationarity of N(t), Y_(-x) = y + (t), the 
covariance density function can be defined over the entire 
real line by 



Y ( t ) 



m{rn f ( t )-m} , t r 0, 

6 ( t )m , t = 0 , 



(2. A. 2. 11) 



where 6 ( t ) is the Dirac delta function. This arises essen- 
tially from considering the covariance function of the deri- 
vative of a jump function, N(t), which exists only in the 
sense of generalized functions (Daley and Vere-Jones, 1972, 
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Sect. 4). 



The Fourier transform of (2. A. 2. 11) is 



g(u>) = ( 2tt ) _1 f Y(t)e“ lwt dt, w >_ 0 (2. A. 2. 12) 

_00 

where i = v-l7 Since the process is real and stationary, 
m^(t) = m f (-t), and in the limit as t goes to infinity, 
m f (t) tends to m. This permits the alternative form of 
the count spectrum (Cox and Lewis, 1966, p. 7*0 

X *>! 

g + (to) = m{l+m f (iu))+m f (-ioj) }/tt, w ^ 0 ( 2 . A. 2 . 13 ) 

where m f (s) = / m f (t)e dt is the ordinary Laplace trans- 

o 

form of m^(t) . The form of the second order count spectrum 
given by (2. A. 2. 13) is particularly useful in developing 
spectral forms in the superposition process. 

Further, a very useful relationship exists between 
the variance-time curve and the second order count spectrum: 

limV'(t) = 7T lim g + (w), (2. A. 2.1*0 

t^°° CH~ 

where V'(t) is taken to be the time derivative of the 

variance-time curve, V(t) . That is, the asymptotic slope 

of the variance-time curve is equal to it times the initial 

value of the count spectrum. 

II. A. 3. Properties and Characterizations of the 
Interval Process 

The properties of interest related to the interval 
process are the expectation, E[X], and variance, Yar(X), of 



an arbitrary interval; the coefficient of variation. 



_ [Var (X) ] 

eTxT 



1/2 



(2. A. 3-1) 



the auto-correlation sequence {p^}, and the second order 
spectral density of the interval process, f + (co). 

The autocorrelation sequence, -[ p ^ } is given by 



Pj = (E[X n X n+j ] - E[X j )/Var (X) , j = 0,±1,±2, 



(2.A.3.2) 



The second order interval spectral density is the 
Fourier transform of the autocorrelation sequence. That is. 



f (u) = {1 + 2 E p. cos j to } / tt . 0 £ to £ (2. A. 3. 

j = l J 



An alternative formulation of the spectral density 
of intervals has proven very useful in this research. Let 



4>(z,t) = 2 z J *Pr{N(t)=j) (2. A. 3 . H ) 

j = 0 



be the probability generating function for N(t), with the 

y. 

Laplace transform <J> (z,s). Without going into details (see 
Cox and Lev;is, 1966, p. 77) which require a development 
not germane to this thesis, the interval, spectral density 



may be determined from 



CO 



, 0 +) 



(2. A. 3.5) 



f + («) 



* 



<b 



(e ,0+) + (j) (e 
(2<J>"(0,0+) - E(X) } 



This relationship is the basis of one approach to the 
problem considered in this research. 

Finally, a relationship exists between the initial 
point of the count and interval spectra: 



g + ( 0+ ) = C 2 (X)f + (0+)/E[X] . 



( 2 . A . 3 . 6 ) 



II. A. 4. The Superposition Process 

By superposition process , as used hereafter, 
meant the union of the events of several independent 
point processes. That is, let N^(t) be a stationary 
process with iid interevent times, for i = l,...,p. 



is 

renewal 

counting 

Then 



N (p) (t) = Z N (t) (2. A. 4.1) 

i=l 1 

is a stationary superposition process. It should be stressed 
that this is a univariate point process . There is no iden- 
tification of an event in the superposition with its parent 
process . An observation of a superposition process is a 
sequence of times corresponding to the occurrences of events, 
with no other identifiable characteristics. 

In general, a superscript of (p) will indicate that 
the superscripted symbol refers to a superposition process 
of p components. 
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II. A. 5. Special Superposition Processes 



An Erlang renewal process is a renewal process 
with interevent times governed by the Erlang pdf. 



f x (x) = 



A k x (k_1) 



e' Xx /(k-l) ! 



x > 0 



(2. A. 5.1) 



In this thesis, the Erlang pdf will be denoted by y (k,A). 

X 

When p iid Erlang renewal processes are superposed, 
the superposition will be called an E ( k , p ) process . With 
regard to component processes, the term "iid" means that the 
processes are independent and have the same probabilistic 
structure. The scale parameter, A, is suppressed in this 
notation. The sequence of intervals resulting from the 
superposition of p iid Erlang renewal processes will be 
referred to as the synchronous (asynchronous) E(k,p) 
interval process, depending on the starting conditions of 
arbitrary event, or arbitrary time. Denote by N^ P ^(r) the 
asynchronous E(k,p) counting process and by N^ P ^(t) the 
synchronous E(k,p) counting process. 

The hyperexponential renewal process has interevent 
time survivor function 



k 

R (x) = Z q. exp{-A x), x >_ 0 , (2. A. 5-2) 

A j=i J J 

k 

where q, > 0, j = l,,..,k, and 2 q. = 1. The point process 

J .1 = 1 J 

resulting from the superposition of p hyperexponential 



renewal processes will be denoted as an H(k,p;q,A_) process. 
In this notation, £ = (q^ . . . ,q k ) and X = (A , . . . , A^) . The 
usage of H(k,p;£,A_) will be the same as for E(k,p). 

The letters k and p will be reserved for the special 
usage indicated in this section. Thus, p is the number of 
component processes in a superposition, and k is the shape 
parameter of an Erlang distribution, or the number of ex- 
ponential terms in an hyperexponential distribution. The 
exact interpretation of k will generally be clear from the 
context . 

II. B. PROPERTIES OP THE SUPERPOSITION PROCESS 

Known results regarding superposition processes may be 
divided roughly into three categories. The first category 
is that of asymptotic and Poisson related properties, and 
is covered in Subsection II.B.l. The second category, 
dealing with the counting process and the marginal interval 
is covered in Subsection II. B. 2. Finally, the joint inter- 
val and spectral properties are listed in Subsection II. B. 3 . 

II.B.l. The Asymptotic and Poisson Related Properties 
of a Superposition Process 

The relationship of the Poisson process and super- 
position process is well covered by Cinlar (1972). The 
gist of the results presented are 

a. Under fairly broad conditions, if a stationary 
renewal process is the superposition of stationary renewals. 



each is Poisson. 



b. As the number of component processes is increased 



with the time scale adjusted so that the mean time between 
events in the superposition is held constant, the resultant 
process is approximately Poisson. There are some subtleties 
regarding this asymptotic result which will not be considered 
here as they have no bearing on this research. Essentially, 
the limit holds if no component process contributes inordi- 
nately to the total number of events. 

II. B. 2. Count and Arbitrary Interval Properties of 
the Superposition Process 

Several properties of the superposition of indepen- 
dent, stationary renewal processes are additive, and require 
little elaboration. Let IL ( t ) , i = l,...,p, be a set of 

independent, asynchronous renewal counting processes, with 
(d ) P 

N H (t) = I II. (t). Clearly, the mean-time and variance- 
i-1 x 

time curves are 



For ease of notation, suppose the component processes are 
probabilistically identical, where M(t) and V(t) denote the 



M (p) (t) = Z M. (t) 
i=l 1 



(2.B.2.1) 



and 



v (p) (t) = Z V (t) . 

i=l 



(2 .B. 2. 2) 



common forms for the component processes. The, if X 



(c) 



is 



an arbitrary interval in a component process , and X 



(P) 



is 



an arbitrary superposition interval. 



E[X (p) ] = E[X (c) ]/p. (2.B.2.3) 

The pdf of an arbitrary superposition interval, 
first given by Cox and Smith (195*0 , is (assuming iid 
component processes) 

- CO 

f (P) (t) = - ^jrOytMu" 1 / R c (u)du) P “ 1 }, ( 2 . B . 2 . *1 ) 

t 

where R (t) is the survivor function of the component process 

( c ) 

interval and y = E[X ]. Development of this form for 
particular processes is presented in Chapter VII of this 
dissertation . 

Cox and Lewis (19 66) give the result 

m£ p) (t).= m f (t) + (p-l)m (2.B.2.5) 

based on the idea that an arbitrary event in the superposi- 
tion process occurs at an arbitrary time in all but one of 
the component processes. 

Enns (1970) determined that for the superposition of 
iid renewal processes, if the log survivor function is 
concave (convex), then so is the log survivor function of 
the superposition process. In the terminology of reliability 
theory, if the component processes have monotone hazard rate. 
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then the hazard rate of the superposition is monotone in 
the same direction. 

II. B. 3* . Second Order Count Properties of the 
Superposition Process 

Taking the covariance function of a stationary 
counting process as in (2. A. 2. 10), and using (2.B.2.1) and 
(2.B.2.5) yields the covariance function of the stationary 
counting process of the superposition 

yj p) (t) = m (p) (t){m^ p) (t) - m (p) (t)} 

= pm{m f (t) + (p-l)m - pm) 

= PY + (t). (2.B.3.1) 

Similarly, taking the Laplace transform of (2.B.2.5) 
and substituting in the expression for the count spectrum 
of a stationary process (2. A. 1.10) gives 

(d) * * 

g+ '(co) = pm{l+m fl (ico)+m ;f .(-iu) }/ir 

= P£ + ( w) . ( 2 . B . 3 • 2) 

These results have the following interesting inter- 
pretation. If the component processes are iid renewal 
processes, and if g| P ^(to) and p are known, then so is g + (w). 
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This in turn determines the interval properties of the 
component processes. Thus, in theory everything is known 
about the process. 

If p is not known, however, it is precisely this 
linearity, or additivity, that makes g| p ^(co) relatively 
uninformative . 

Note that the intervals in the superposition process 
are correlated and their structure is complicated and diffi- 
cult to find in practice. However 1 , it is this complex 
structure that makes their investigation (particularly 
second order properties) worthwhile for clues to the 
underlying nature of the superposition process. 

II.B.lJ Second Order Interval Properties of the 
Superposition Process 

There is, in principal, a means of determining the 
second order interval spectrum of the superposition process. 
From the definition of the superposition of independent, 
identically distributed renewal processes, and (2.A.3.^)> 
it is clear that the generating function of the superposed 
counting process is 

<}/ p \z,t) = <J p (z,t). ( 2 . B . . 1 ) 

# 

Now, <t>(z,t) is the inverse Laplace transform of <J> (z,s) 
which, for a renewal process, is 



l 
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5 



(2.B.H.2) 



* 



<P (z, s) 



1 - f"(s) 
s{l - zf (s)} 



given by Lewis, et al (1973), where f (s) is the Laplace 
transform of the renewal interval pdf. The Laplace trans- 
form of (2.B.14.1) yields the information required in 
(2. A. 3 . 5) to determine f| p ^(w). 

The procedure outlined above is explained in more 
detail in Chapter III. The inverse Laplace transform of 
(2.B.H.2) is not a trivial problem, nor is the expansion of 
d p (z,t) once <f(z,t) has been determined. In the case of 
the E(k,p) process, Lewis, et al (1973) developed a compu- 
tational form which is the basis for a major portion of 
this research. 

The joint density function of several intervals in 
the superposition process was derived by Lawrance (1973) - 
The basic argument can be illustrated in terms of the joint 
density of two adjacent intervals in the synchronous inter- 
val sequence. Conditioning on the first interval starting 
v:ith an event in process 1 at t = 0 , the probability that 
the first interval is terminated in (t-^,t^+dt) by an event 
in process 1 and the second interval is terminated in 
(t 2 ,t 2 +dt) by an event in process 2 is 



f l (t 1 )R 2(t2 )R 1 ( t 2 _t 1 )(y 2 ) 



-1 



(2.B.*» • 3) 
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where f^(t), R^(t) and y i are respectively the pdf, survivor 
function and expectation of an arbitrary interval in com- 
ponent process i, i = 1,2. Taking all combinations of pro- 
cesses responsible for an event, and starting conditions, 
expressions of the form (2.B.3.5) are added to give the 
joint density of the adjacent intervals in the superposi- 
tion process. In the case of two iia renewal processes, 
the joint density of two adjacent intervals in the 
superposition is 





>x 2 ) 



= f(x 1 )f(x 2 ) f R(u)du/y 

V*2 

+ R(x 1 )f (x 1 +x 2 )P.(x 2 )/y 



+ f(x 1 )R(x 1 +x 2 )R(x 2 )/y 



+ R(x 1 )f (x 2 )R(x 1 +x 2 )/p . 



Lav.'rance (1973) used this procedure to determine serial 
correlations of one, two and three lags for certain pro- 
cesses. In Chapter V of this thesis, the joint density 
function for intervals of a semi-Harkov generated point 
process is derived, and used in Chapter VI to derive joint 
information regarding the intervals of the E(k,p) and 
H(k,p;a,_X) processes. 
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III. SECOND ORDER SPECTRAL ANALYSIS OF THE 



E(k,p) INTERVAL PROCESS 

The second order spectra of counts and intervals of a 
point process are available from easily derived formulae 
(Cox and Lewis, 1966, Ch . 4). Lewis, et al (1973) have 
established a computational method for determining the 
interval spectrum of an E(k,p) process. While the compu- 
tational method is unwieldy for even small values of k and 
p, its application provides considerable insight into the 
use of the interval spectrum in the analysis or modelling 
of a point process. 

This chapter deals at length with the second order 
interval spectrum of the E(k,p) process, demonstrating some 
general results. The interval spectrum provides a natural 
analytic tool for the superposition because of the cyclic 
nature of the process. For example, if three processes are 
superposed, approximately every third event comes from 
process 2. In Section A, the general form of the spectrum 
is established. It is shown constructively that the spec- 
trum is the ratio of finite degree polynomials in cos(w/k), 
wher e to is the argument of the spectrum. A theorem is pro- 
posed which relates the E(k,p) interval spectrum to that 
of a stationary, finite, mixed autoregressive/moving average 
process . 

The special cases of the E(2,p) and E(^,p) processes 
are considered in Section B. Both processes are shown to 



have spectra expressible as the ratio of finite polynomials 
in cos to, and an upper bound on the order of the polynomials 
is established. 

Section C gives the method for determining upper bounds 
for the orders of the ARMA process which is similar to an 
E(k,p) process. 

The second order spectrum of counts is considered in 
Section D. The results of Cox and Lewis (19 66, Ch. 4 and 
8) with regard to the count spectrum is applied to the 
Erlang superposition process. The initial point of the count 
spectrum is determined for the E(k,p) process. Section E 
contains some remarks regarding the use of the material of 
Chapter III along with the methodology proposed by Cox and 
Lewis (1986) for the characterization of point processes 
and Box and Jenkins (1970) for ARMA model identification. 

III. A. THE INTERVAL SPECTRUM OF AN E(k,p) PROCESS 

V, T e recall again the idea that in a rough sense, the 
spectrum of intervals will be more informative in analyzing 
superpositions than the spectrum of counts. This is because 
the interval spectrum relates to the phenomena related to 
serial number and on the average, every p-th event comes 
from a given process. This serial number effect is a 
"hidden periodicity" in the data. In this section two 
methods of direct computation of the second order spectrum 
of intervals of an E(k,p) process are discussed. First, 
the method of Lewis , et al (1973) which has been used 



successfully to generate numerical representations of the 
E(k,p) interval spectra for various values of k and p. 

The second method for determining the E(k,p) interval 
spectrum is a variation on the first which simplifies the 
determination of an analytic expression in the form of the 
ratio of two cosine polynomials. This second method is 
satisfactory for small values of k and p. 

III.A.l. The Computational Form Of The E(k,p) Interval 
Spectrum 

The interval spectrum of a stationary point process 
is defined to be the Fourier transform of the auto-correla- 
tion coefficients. That is (2. A. 3-3) 



f + < “ ) = 2? 1 p j e 
J--~ J 



-1J CO 



(3- A. 1.1) 



where i is the square root of -1, and 



p j = 



E{[X„-E(X)][x. . ,-E(X)]} 

O t-lfl 

Var(X) 



, J = ±1, ±2, 



For the asynchronous process, let 



N(t) = (the number of events in (0,t]), 



and denote the generating function of this asynchronous 
counting process by 



<J.(z,t) = E s n PrO.'(t) - n) . 0 < z < 1. (3- A. 1.2) 
n=0 
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Denote the Laplace transform of b(z,t) by 



4>*(z,s) = / e st 4>(z,t) dt. (3. A. 1.3) 

0 

Since |<J>(z,t)| <_ 1 for all z and t >_ 0 , this transform 
exists at least for Re | s | > 0. Cox and Lewis (19 66, Ch . 4) 
have shown that (3. A. 1.1) can be expressed in terms of 
(3. A. 1.3) by (2. A. 3-5) 



f + <“) = 



*/ ico x 
- b (e , C+ ) 



, * , -iw n , x 

t (e ,0+) 



(2<f) (0,0+) - E(X) } 



(3- A. 1.4) 



Lewis, et al (1973) noted that in the case of the super- 
position of renewal processes, the Laplace transform of 
a component asynchronous counting process is easily obtained 
from the Laplace transform of the interval distribution. In 
particular, using the identity for the synchronous process 
(2. A. 1.4) 



n 

N f (t) > n<=> E X. < t , (3- A. 1.5) 

j = l J 



the generating function of the synchronous counting process 

is 



$ f (z,t) = E z n {P ( t ) -F +1 ( t ) } , 
n=0 



(3- A. 1.6) 



n 

where F (t) = Pr{ I X. <_ t), and F (t) = 1. Then the 
n j=l J o 
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Laplace transform of (3. A. 1.6) Is 



<J> f (z,s) 



(1 - f*(s)} 
s{l - zf (s) } 



(3. A. 1.7) 



it w , 

where f (s) = / e s dF(t). 

o 

Cox and Lewis (19 66, Ch. *0 provide the relation- 
ship between the generating functions of the synchronous 
and asynchronous processes: 



4>(z,t) 



1 + 



(z-1 ) 

TUT 



t 

/ <f> r (x,u) 

0 



du . 



(3. A. 1.8) 



The Laplace transform of (3. A. 1.8) is 



4> (z,s) 



1 (z-1) fl-f*(s) } 

s s 2 E ( X) { 1— zf *' ( s ) } 

sE(X){l-zf*(s) } + (z-l){l-f*(s)} 
s 2 E(X) (1-zf (s) } 



(3. A. 1.9) 

* 

Thus 6 (z,s) for one of the (identically distributed) 
component processes is a function of the Laplace transform 
of the interval density. Mote further that the generating 
function of the pooled asynchronous process is, since the 
component processes are assumed to be independent. 



b 



(P) 



(z 



II, (t)+ . . .+!I (t) 
) =-• E[z 1 P 



] 
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(3.A.1 .10) 



JMt) p 

{E [ z 1 ]} 



= 4> P (z,t) 



The information required for determining the Laplace 



transform of the asynchronous superposed process is now 
available and can, in principle, be used in the following 
procedure : 



inverse, respectively. 

Example III.A.l. The E(2,2) process. We now 
determine the Laplace transform of the generating function 
of the asynchronous counts in the E(2,2) process. The 
Laplace transform of the Erlang density function is 



Substituting (3-A.1.12) and (3-A.1.13) in (3-A.1.9) leaves 




(3. A. 1.11) 



where L and L ^ denote the Laplace transformation and its 



f (s) = (1 + s/A) 



-2 



(3. A. 1.12) 



and 



E(X) = 2/A . 



(3- A. 1.13) 
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2s + (3+s) X 

2{A 2 (1-z) + 2As + s 2 } 



(3- A. 1.14) 



* 

4 > 



(z,s) = 



To invert (3.A.1.14), it is convenient to substitute 
a = -A(l+ z) and b - — X ( 1— z), so that 



4> (z,s) 



2s + ( 3+z ) 
2 ( s-a) (s-b ) 



(3. A. 1.15) 



Use of a standard inversion formula (Gardner and 
Barnes, 19^2; Selby, 1969) results in 



<|>(z,t) = (b 2 e at - a 2 e bt )/(^Xv r 2) . (3-A.1.16) 



The generating function of the superposed process 



is then 



<f>^( z,t) = 



<P (z,t) 



2 at 0 ,4,_ \ 2 -2At, 4 2bt, / ,,£,2 * 

= {b e -2A (1-z) e +a e } / ( 16 X z) 



(3- A. l.l?) 



The Laplace transform of (3. A. 1.17) is 



9 



*( 2 ) 



(z,s ) 



b 



H 



s-2a 



2A V 1-z ) 2 + a} 
si-2 s-2b 

-16a 2 z 



(3. A. 1.18) 
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To continue the general case, Lewis, et al (1973) 
give the general form for the generating function of 
asynchronous counts in an Erlang renewal process: 



4> ( z , t ) = 



(z-l) 2 /(k 2 z) 



k 

Z 



{ T./( T.-l) 



}exp{-X( x. — 1 ) t ) 

J 



(3. A. 1.19) 



where are the k distinct roots of z. Using 

(3. A. 1.19) to form the corresponding generating function 
for the superposed process results in 






k 

Z 

h ml 



n 



T . 

1 



-X Z (t.- 

^ e J ' eJ ^ 
j =l\jeJ(T -l) 2 / 

p 3 (3. A. 1.20) 



k 

Z 



where J = ( j J 2 > • • • > Op) as an index vector whose components 
run from 1 to k. The Laplace transform of (3. A. 1.20) is 



<>* (p) (z,s) = 



(z-1) 

k 2 z 



k 

Z 

V 1 



k 

Z 



n 

jeJ 



T . 

J 

(t,-1) 



j =1 ( s-X ).Z (x -l) 

p 0<f J 



(3.A.1 .21) 



Further, it can be shown that by letting 



Q,(k,p) - {[24>* (p) (0,0-t-)-k/(pX)]} 



-1 



that 



fj p) (w) 



(k ,p) { (1 -coscj) P /(AI; 2p ) } Z. 



k 

Z 



2a 



^ J" p 1 (Sj+bjjCj 



(3. A. 1.22) 



where 



a J 



P 



2 cos(^^) , 

j e- 7 



b 



J 



£ sln( 2iit“) 

Je J k 



3 



and 



c, = n ( i-cos ■ “ )) . (3.A.1.2S) 

J JeJ k 

This computational form was used by Lewis, et al 
(1573) to generate numerical representations for several 
E(k,p) processes, and for k = 2, p = 2, 3 and 4 analytic 
expressions were derived. It will receive more attention 
in Chapter VIII below ’with regard to computation of interval 
spectra numerically. 

It should be noted that Q^(.k,p) (3. A. 1.22) is 

difficult to evaluate directly. Two methods of determining 
Q^(k,p) are discussed in Chapter VIII. 

II I. A. 2. A Variation Of The Corputat ior.al f-’othod For 
Determining K(I:,p) Interval fpectra 

The computational form (3- A. 1.22) has proven very 
efficient In the numerical representation of E(k,p) .interval 
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spectra. The modification proposed in this subsection is 
designed to assist in deriving an analytic expression for 
the second order interval spectrum of an E(k,p) process. 

In particular, the relationship of an E(k,p) second order 
interval spectrum and the spectrum of an ARMA process is 
explored . 

An ARMA(m,n) process has a spectral representation 
which is the ratio of two finite polynomials in cosine w. 
That is, for the ARMA (m,n) process, 

n j 

E oucos w 

f + (w) = ^ , (3. A. 2.1) 

* p 

E B cos to 
r=0 r 

v.’here the limits of summation correspond to the orders of 
the autoregressive and moving average components of the 
ARMA process . 

It will be shown (Theorem III. A. 2; Chapters V and 
VI) that the E(k,p) second order interval spectrum has the 
form of (3- A. 2.1), hence second order serial properties 
identical with those of an ARMA process. 

This subsection contains the framework through 
which upper bounds for the parameters m and n of (3- A. 2.1) 
may be established. 

Observing that aj, bj and Cj (3- A. 1.23) depend only 
on indices in J and not on the order, (3. A. 1.22) can be 
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■written in the alternative form 






Q x (k ,p) 



( 1-COS03 )^ 



Ak 



2p 



n 



2a, 



V 

n=r 



n 



(af +bf ) c I 



n 



n 



n 



(3- A. 2. 2) 



v:here t n = (r^,...,r^) is a vector of dimension k corres- 
ponding to each distinct vector J which indicates the number 
of elements of each denomination in J. (The elements r., 

of L should retain the subscript n to indicate their 
n 

relationship to L . This form of notation rapidly becomes 
awkward and where there is no ambiguity the subscripts will 
be suppressed.) For example, let k = 5 and J = (3>5,3>3)- 
The corresponding index designation vector is L - (0,0, 3, 0,1). 

We will call L an index designation vector. The notation 

n 

is taken to be the multinomial coefficient p!/(r, ! . . .r. !), 
n 1 K 

and represents the number of distinct permutations of J. 

k /k+p-l\ 

It should also be noted that Z r. = p, and that N = ( ) 

j=l 3 \ P / 

is the figurate number for k types of objects taken in sets 

of size p (see Riordan, 1958, pp . 25). In this notation, 

further suppressing the subscript n, the terms of ( 3 . A. 1 . 23 ) 

may be written 




a , = 



k 

Z i 

j=l 



co: 



( 2tt 1 1_+i0) 



6'l 



P 






b 



L 



S Sin(2ll±il) 

3-1 



and 



C L 



k ~ . , r . 

n u-cos(^lf±“)} o 

J=i k 



(3. A. 2. 3) 



Clearly, the coefficients M J do not depend on the 

order of the elements in L . It will be convenient to com- 

n 

bine in a single set, R^, t - 1,...,T those vectors, L , 
which are made up of the same elements . Thus we take 
R t = { (r^ , . . . ,r^) } to be the set of distinct k-vectors with 
elements {r^,...,r^} in any order. L e R^ will refer to a 
particular index designation set. In the above example, 

L o = (0,0, 3,0,1) and = (3 , 1 , 0 ,0 ,0) would both be members 

of the same set, R^ = {(3,1. -0,0,0)}. We now restate (3* A. 2.2) 
as 



4 P) ( W ) 



Q x (k,p) 



(1-cos to) 



Xk 



2p 



* ( 

t=r 



p ') 

v 



2a 



E 

Le R 



L 



t (a L +b L )c L 



(3* A. 2.4) 



In this form, f| p ^(to) can be examined in detail by examining 
the groups of similar terms, i.e., terms with index 
designators, L, all taken from the same set, R fc . 

In the following pages the forn of the right hand 
side of (3- A. 2. 4) will be examined in detail. It will be 
shown in Lemmas III.A.l and III. A. 2 that the right hand 
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side is expressable as the ratio of finite polynomials in 
cosine ( to/k) , with the term (1-cos co) p cancelling out of the 
expression. The proofs are constructive and the algebra is 
cumbersome. However the exposition is considered necessary 
for the computational work which will be addressed in 
Chapter VIII. 

Lemma III.A.l: For some integer k greater than 1, 

let be the set of k-tuples whose elements are distinct 

permutations of { (p , 0 , 0 , . . . , 0 ) } . Denote the elements of 

by L , n = 1 ..... k . Then 
n 



n 



k 2a i 

Z 2 o 
n=l(a^ )c^ 

L n L n n 



v p(k-D 

(2 K i ) P I d . cos (nco/k ) 
,1 = 0 J 

p(l - cos co) P 



(3- A. 2. 5) 



for some real sequence {d.}. 

J 

Proof: From (3. A. 2. 3), and denoting by n ‘the 

subscript L , we have a = p { 1-cos (~-^) } b = psin( ^ ■ TT i 1+ --) 
n n k ’n k 

and c = { 1— c os ( — — y~— -) } p , n = l,...,k. Evaluating a 

T"1 rC 

typical term, 

„2 , u 2 2 fn 0 ^ ,2-rm+o^ _ 2,2™+^ , J „2 / 2Tm+w N 

a n + b n = P ' 1-2cos (~k — ) + cos ( — £ — ) + sin ( — Yc — ' ' 

= 2p 2 {l-cos( ?7T p +0i )} = 2pa , n = l,...,k. (3-A.2.6) 
K n 
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Using (3* A. 2. 6 ) gives 




and (3.A.2.5) becomes 



k 

Z 

n=l 



2a 



n 



(a 2 +b 2 )c 
n n n 




A common denominator for ( 3 . A. 2. 8 ) is 



(3- A. 2. 7) 



(3.A.2.8) 



d = P n c = P { n [i-cos(^^)]} p . 
n=l n n=l K 



Jolley (1961, p. 200) gives H (1-cos ( 2up — ) } = 2 1 _,< (l-cos co), 

n=l K 

with proof credited to E.P. Adams of the Smithsonian 
Institute. Thus 



D = p{2^ ^(1-cos co)) P . 



(3- A. 2.9) 



Given the common denominator, D, the numerator in 
(3-A.2.8) is 



Jr 

H = Z n (1-cos (^~ik)} P . ( 3 . A. 2 . 10 ) 

j = l n*J K 

Using the standard trigonometric identities 
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cos(a+b) = cos(a)cos(b) - sin(a)sin(b) , 



and 



sin(a+b) = sin(a)cos(b) + cos(a)sin(b) , (3. A. 2. 11) 



it is easily shown that 



cos ( ) = cos ( w/k ) cos ( 2Tm/k ) - sin(w/k)sin(2Tm/k) , 



cos(2im/k) = cos ( 2tt (k-n )/k ) , 



and 



sin(2irn/k) = -sin(27r(k-n)/k) . (3 -A. 2. 12) 



Using (3- A. 2. 12), (3-A.2.10) may be expressed as 



* 

k p 

N = Z { [1-cos (to/k) cos ( Zun/k ) + sin(w/k)sin (2irn/k) ] 
n=l 

P 

+ [1-cos (to/k ) cos ( 2im/k) - sln(w/k)sin(2-rrn/k) ] } 

2 2 p 

x{ Z [( 1-cos (w/k ) cos (2irn/k ) ) - ( sin ( w/k ) sin ( 2Tin/k ) ) ]} 

j^n 



+ 



* 

k 2 

{ n [(l-cos(w/k)cos(2un/k) ) 

J = 1 



2 

(sinw/k)sln(2un/k) ) ]}U(k) 

(3- A. 2.13) 
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# 

where k 



L(k-l)/kJ 



and 



P P 

{1+cos (w/k) } + {1-cos (co/k) } , 



U(k) = < 



{ 1— co s (to/k ) } , 



k even 



k odd. 



The symbol |_xj is taken to mean the largest integer less 
than or equal to x. 

The product terms in (3. A. 2.1 3) have components 

2 2 
(1-cos (2mn/k)cos (w/k) ) - ( sin (27m/k) sin (to/k ) ) 

= 1 -sin^ ( 2Trn/k) - 2cos (to/k) cos (2mn/k) + cos^(w/k) 

2 % 

= (cos(2Trn/k) - cos(w/k)} , n = lj...,k (3. A. 2.14) 



Let A = 1 - cos ( 2:rn/k ) cos (to/k) and 
n 

B^ = sin(27rn/k)sin(w/k) . Then components of the first term 
of (3* A. 2. 13) can be written 



P P P , nN r _i i J 

(A +B ) + (A -B ) = Z (5) {A*' J [E J + (-B ) ]) 

n n n n , n Vj/ n L n n 

.i -U ' 



= 2 






A P 

n n 



(3- A. 2.15) 



* 

where p = [(p+l)/2j. Since = sin (2im/k ) sin (u/k ) , 

B 2 ^ = {sln 2 (2rn/k) [(l-cos 2 (to/k) ]}'^ . Using the results of 
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(3. A. 2.14) and (3. A. 2. 15), (3. A. 2. 13) can be written 



* * 

k p p-2j 

N = 2 Z { Z ( [ 1-cos (co/k) cos (27in/k)] 

n=l j=0 v ^ 

2 j ? j 

x[sin(2Trn/k) ] [1-cos (co/k)] } 



2 P 

x{ IT [cos(2Trn/k) - cos(co/k)] } 
jrn 



* 

k 2 p 

+ { H [cos(27rn/k) - cos(co/k)] } U(k) 
n=l 



(3. A. 2. 15a) 



where 



* 

P 

Z 



3 = 0 



o 

2j 



U(k) =< 



2j 

[cos (co/k)] , 



P 

[ 1- cos ( co/k) ] , 



k even 



k odd 



Examination of ( 3 • A . 2 . 15a) reveals that it is a 
polynomial in cos(co/k). The degree of the polynomial is 
most easily determined from inspection of ( 3 . A. 2. 8). 
Writing 



1 

P 



k 

2 

n = l 



1 



c 



n 



k 

2 n c . 

n=l .i/n J 



k 

p n 

n=l 



n 



/ 
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it is clear that each term of the numerator has at most 
degree (k-1) times the degree of c . Since each term 

P 

c^ = {( 1-cos ( 2mn/k) cos (co/k) + sin(2irn/k)sin(to/k) } , 

it is of degree p. Thus there exists a set of coefficients 
{d^} such that, using standard trigonometric identities 
(Appendix B) 



p(k-l) 

N = I d cos n (to/k)j 
n=0 n 

thus completing the proof of Lemma III.A.l. 

It is worth noting that the expression p(k-l) 
represents a weak upper bound on the degree of the numerator 
term, H. A tighter upper bound on the degree is 
k[p(k-l)/kj, which follows from Theorem III. A. 2 below. 

This fact is important in the comparison of the E(k,p) 
interval spectrum with that of a mixed autoregressive/moving 
average process. 

Having established in Lemma II. A. 1 the form of a 
special class of terms of (3-A.2.2), the more general form 
is considered below. Lemma III. A. 2 will show that all terms 
of the E(k,p) interval spectrum can be expressed in terms 
of cos (to/k) . 

Lemma III. A. 2: Let be the set of all distinct 

permutations of the k-tuple (r^ ,r^ . • • • >r^) » v> 'ith r^ _> 0, and 
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the sum of the r^ equal to p. Denote the elements of R 
by L , n = 1,...,N, where N Is determined from specific 
knowledge of R . Then 



N 

Z 

n=l 



2a 



(a L +b 
n 



2 

L 

n 



)c 



L 

n 



W 



t 



Z d.cos 
2=0 J 



Ttf 

1 t 
Z 

m=0 



s . cos 
J 



k 



jco 

k 



1-cos to 
„k-l 



r 



(3. A. 2.16) 



where r = max. {r, }, and VI = N. + kr - p . 

J j t t 

Proof: It will be shown first that in constructing 

a common denominator for (3. A. 2 . 16 ), all terms containing 

odd powers of sin(to/k) cancel, while even power terms have 

a cosine representation. Following this, it will be shown 

that the same phenomena occur in the numerator when the 

expression is placed over a common denominator. 

Examine the denominator of (3.A.2.16) first. The 

k _ t 

terms c. , L e R. , are of the form II { 1-cos (■- T' -1 — ) } r * , and 
L u n=l K 

have as a common multiple, 
k p ( r 

IT [ 1— co s ( — — P — — ) 3 , where r is the largest of the r., 
n=l ^ 

j = l,...,k. Recalling the result stated in (3. A. 2. 9), 

wri te 



D 

c 



r 0 l-k , t 

{2 (1-cos 



r 

co) ) 



(3- A. 2. 17) 



which coincides with one term in the right hand side of 

(3. A. 2.16) . 
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For the index designation vector L = 



applying the identities ( 3 . A. 2 . 11 ) gives 

k k 

a. = p - cos(w/k) Z r . cos( 2iTj/k) + sin(w/k) Z r .sin(2irj/k) , 
L j=l J j=l J 



and 



k k 

b. = cos(w/k) Z r .sin(2irj/k) + sin(w/k) Z r . cos ( 2irj/k) 



i = l 3 



j=l 3 



(3. A. 2. 18) 



Using (3 -A. 2. 18 ), form 



+ bf = p^ + Z r? + 2 Z Z r r . cos ( 2( j-n)Tr/k) 

L L J=1 J n=l j =n+l n 3 

k k 

- 2p{cos(w/k) Z r . cos ( 2nj/k) - sin(w/k) Z r . sin ( 2n.j /k) } 
j=l J j = l 



k k 

= V. - 2p{cos(w/k) Z r . cos ( 2tt j/k) - sin(w/k) Z r . sin ( 2ttj /k ) } 
1 j=l J j=l J 

(3. A. 2.19) 



with suitably defined. 

Nov;, let rj - r. . , i = l,...,k-l, and let r,' - r. . 

i k-i * k k 

Then the vector L' = (rj,...,r^) will be referred to as the 
counter element of L in R^ . By applying the identities 
( 3 . A. 2 . 11 ), the following expression is realised: 
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V 



L 



k 

-2p{cos(w/k) Z r . cos (2irj/k) 
j = l J 



k 

+ sin(co/k) Z r . sin( 2-rrj/k ) } 

j=l J 

(3- A. 2. 20) 



which differs from (3. A. 2. 19) only in the sign of the final 
summation . 

For each element L of R^ there may be at most one 
counter element L' so formed. Where such a counter element 
is formed j a common multiple of the denominator in terms of 
(3.A.2.16) will include the product of ( 3 . A. 2. 17 ) and 
(3* A. 2. 18 ). This product is 



V 2 , - ^p 2 { Z r .sin(27ij/k)} 2 
j = l J 

k 

- JJpV. { Z r . cos ( 2 tt j /k) } cos (co/k) 

' J=1 J 



+ ^p 2 cos 2 (o/k) { [ Z r .cos (2nj/k) ] 2 

j = l J 



+ [ Z r . sin(2:ij/k) ] 2 } 

J = 1 J 



(3- A. 2. 21) 



which is a second degree polynomial in cos(u/k). 

It is possible that some elements of R^ v/ill not 
have counter elements. This will occur when, for 
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L = (r^,...,r^), r^ = i = l>...,k-l. In this case 

k 

I r . sin (2mj /k) = 0. 

j = l J 

2 2 

Thus no sin(u/k) terms will appear in a^ or (a^+b^). Hence 
the denominator can be expressed as the product of 
second degree polynomials in cos(w/k) and = N - 2N^ 
first degree polynomials in cos(w/k), along with D c (3. A. 2. 17). 
Here, is the number of element pairs in which are 
mutually counter elements. As noted after Lemma III.A.l, 

N is a weak upper bound on the degree of the denominator. 

A more restrictive upper bound actually realized in some 
test cases is K = k[N/kJ . 

Having established the form of the denominator in 
(3.A.2.16), we continue with the proof of Lemma III. A. 2 
by examining the numerator. Again, let L and L' be counter 
elements of R . Placing just these terms over a. common 
denominator gives the expression 



k . r— r* ! 

N, = 2s, (aP.+bf, ) n {1-cos (-;- + —) } J 

j=l k 



+ 2a,,(a, 2 +bf) n {l-cos(^f^)} r 
j = l K 



(3.A.2. 22) 



where r is the maximum element of L . 

Again, imposing the identities ( 3 . A. 2. 11) and 
(3. A. 2. 12), the product terms of ( 3 . A. 2. 22) are 
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n {l-cos(^i^)} 

j=i k 



= n {l-cos (w/k)cos( 2 irj/k) + sin(w/k)sin( 2 nj/k) } ^ 
j=l 

7 t 

k j z t “in z * 

= n { E [l-cos ( 2 ir,j/k)cos(oj/k) ] J * [sin( 2 uj/k)sin(a)/k) ] m ( 
j=l m=0 vm/ 

(3. A. 2. 23) 



and 



k o n -U 2 • 

n {i-cos( -\ ' - M )) J 
j=i K 

k ^ t) z ~rn z 

= n { Z [-cos ( 2 it j /k) cos ( w/k ) ] J ' [-sin (2irj/k) sin (w/k) ] m ( 7} 
j=l m=0 n 

(3 . a. 2. 24) 

where z. = r - r . . Clearly, (3 . A. 2. 23) differs from (3.A.2.24) 

J J 

only in the sign- of the coefficient of the odd powers of 
sin( w/k) . 

Continuing with the proof of Lemma III. A. 2, to 
simplify the exposition, in (3-A.2.18), (3. A. 2. 19) and 
/ (3.A.2.20) make suitable substitutions to let 



a^ = p - A + Bsin(w/k) 



a^ , = p - A - Bsin(w/k) 



(a L +b L ) = <V L - A + Bsin(w/k) }2p 
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(a 2 ,+b 2 ,) = {V L - A - BsinCu/k) }2p 



so that in (3. A. 2. 22) 



a (a 2 ,+b 2 ,) = 2 d[V p-pA-AV +A 2 -B 2 sin 2 (w/k) 

ILL ' L L 



+ B(V L -p)sin(u/k)] 



(3. A. 2. 25) 



and 



a L ,(a 2 +b 2 ) = 2p(V L p-pA-AV L +A 2 -B 2 sin 2 (w/k) 

- B(V L -p)sin( u /k)) (3. A. 2. 26) 

Again, (3. A. 2. 26) differs from (3. A. 2. 25) only in the sign 
coefficient of sin(w/k). 

Similarly, the product of (3. A. 2. 24) and (3. A. 2. 26) 
differs from the product of (3. A. 2. 23) and (3-A.2.25) 
only in odd powers of sin(w/k), hence summing these two 
products will result in the cancellation of all odd powers 
of sin(w/k), leaving only the even powers which are readily 
convertible to even powers of cosCu/k). 

Thus, each pair of terms corresponding to mutually 
counter elements of R , when placed over a common denominator, 

X/ 

form a numerator which is a polynomial in cos(w/k). To put 



77 



the entire expression (3.A.2.16) over a common denominator, 
it remains only to multiply N L in (3. A. 2. 22) by a term of 
the type shown in (3- A. 2. 21) for each remaining pair of 
mutually counter elements in R^, and a term of the type 
shown in (3. A. 2. 20) with the coefficient of sin(w/k) set 
to zero for each remaining element of R^. This will retain 
the form of a polynomial in cos(w/k), thus establishing 
the nature of the numerator in (3.A.2.16). It remains in 
the proof of Lemma III. A. 2 to derive the degree of the 
numerator as a polynomial in cos(w/k). 

The degree of the polynomial (3* A. 2. 22) when 
placed over a common denominator is typical, and will have 
degree 



k 

W = 2 + 2(N ? -1) + N + Z (r-r.), 

1 i=l 1 



where N~ is the number of pairs of mutually counter elements, 

k 

N, is the number of elements without counters and I (r-r.) 

1 i=l 1 

is the number of terms which must appear in the numerator 

to include D (3* A. 2. 17) in the denominator. Since 
' c k 

N_ = N - 2 Np, W = N + £ (r-r.) and the proof of Lemma 

1 d i=l 1 

III. A. 2 is complete. 

As before, W actually represents a weak upper 
bound, with a more realistic bound being W = k[w/kj . 

An important implication of Lemmas III.A.l and 
III. A. 2 is 
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Theorem III.A.l: The second order interval spectrum 



of the E(kjp) process may be written 



N 




E a cos n (w/k) 

-n n 



(3. A. 2. 27) 



E 3 cos m (w/k) 
m=0 m 



The proof of Theorem III.A.l is a trivial application of 
Lemmas III.A.l and III. A. 2. Its value lies in that the 
interval spectrum of the E(k,p) process can be written in 
the form of the ratio of finite degree polynomials in cos(w/k). 
Computational experience (discussed in detail in Chapter 
VIII) leads to the following: 



interval spectrum of an E(k,p) process expressed as in 
(3. A. 2. 27). Then the right hand side of (3. A. 2. 27) can 
be reduced to 



where N* = [N/kJ, and M' = |M/kJ . 

Discussion: The difference between (3. A. 2. 27) and 

(3. A. 2. 28) is that the former has polynomials in cos(co/k) 
while the latter has polynomials in cos w. The significance 
of this theorem is that it shows the spectrum of intervals 



Theorem III. A. 2: Let f_|^(m) be the second order 




(3. A. 2. 28) 
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of an Erlang superposition to be the same as that of a 
mixed autoregressive/moving average process. This permits 
much of the analysis described by Box and Jenkins (1970) 
to be applied to analysis of these superpositions. 

Even though the intervals of the superposition 
process are distinctly non-normal, the second order 
properties upon which much time series analysis is based, 
are the same for both processes. 

Proof of Theorem III. A. 2 will be deferred to 
Chapter VI, where it is shown to be a special case of 
Theorem V.B.3. Theorem V.B.3 ascribes the form of (3. A. 2. 29) 
to the interval spectrum of a semi-Markov generated point 
process, while Chapter VI deals with modelling the E(k,p) 
process as such a process. 

It might be conjectured that all spectra which can 
be expressed in the form of (3. A. 2. 27) , which is not the 
ratio of rational functions of w, could be further reduced 
to the form of (3. A. 2. 28). That this conjecture is particu- 
lar to the processes considered here and not true in general 

is shown by the following example: 

<» 

Let f.(w) = E 2 - ^ cos jw; Q.(k,p) = 1, k = 2, 

J =0 

N = 1 and M = 3. Let the coefficients in the numerator of 
(3- A. 2. 27) be 8 and -9- Let the coefficients of the 
denominator be 10, -9, -8 and 6. The assertion of Theorem III. A. 2 
is that the coefficients of cos(w/2) and cos(3w/2) must 
be zero in (3. A. 2. 27). Some simple calculations will verify 
that (3. A. 2. 27) represents an identity in this case. 



III.B. SPECIAL CASE RESULTS: E(2,p) AND E(4,p) INTERVAL 

SPECTRA 

The E(2,p) and E(4,p) processes are particularly amenable 
to analysis because of the simple form of the expansions 



cos( — = (-l) J *cos(w/2) , j = 1,2,... (3-B.l) 



sin( 2 - TT - ^ +aJ ) = (-l) J +1 sin(co/2) , j = 1,2,... (3.b.2) 



/2TTj+tO\ J 
COS ( ) 1 



(-l) j sin(co/4) , j = 1,3,5,.. 



(-I) j/2 cos(a)/i0, j = 2,4,6,.. 



( 3 • B . 3 ) 



(-1) ^" 1 ^ //2 cos(to/4) , j = 1,3,5, • • • 



sin(^L^) = 



(3.B.4) 



(_l)J //2 sin(w/4) , j=2,4,6,... 



In the discussion which follows, terms of the form cos(nw) 
and (cos w) n will be treated interchangeably, except where 
the exact coefficient of a term is significant to the 
discussion. This is justified by the trigonometric iden- 
tities and the Chebyshev polynomials, both summarized in 
Appendix E, which relate the two forms. 

III.B.l. The E(2,p) Interval Spectrum 

A tediuous but straightforward construction of the 
E(2,p) interval spectrum leads to the following 
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Theorem III.B.l: The second order spectral density 

of the E(2,p) interval process can be written as the ratio 
of two polynomials in cos to as in (3. A. 2. 28), where N' = p-1 
and m' = L(P~D/2j . 

Proof: For a given value of p, the class, Q., of 

index designator sets is 



{(p,0),(p-l,l),...,(p-|p/2j,[p/2j)}. (3.B.1.1) 

From Lemma III.A.l, for L = (p,0), and L = (0,p), 
in the notation of (3«A.2.3)> 



2a, 2a , 

— . + L — 



2 P Ed. cos (j to/2) 



= n ^ 



(a 2 +b 2 )c L (a 2 ,+b 2 f )c L , 






p(l-cos to) p 



(3.B.1.2) 



which will be denoted by P . 

Looking more closely at the numerator of (3.B.1.2), 



N Q = c + c , = {1-cos (to/2) } + {1+cos (to/2) } 



IP/2J 2 4 

2 E ( P?) cos (to/2) 

j = 0 

IP/2L _ j 

2 E ( P A (1+cos to) , 
j =0 



(3-B.1.3) 



Using appropriate trigonometric identities and 
making the obvious substitutions, ( 3 .B.I. 3 ) can be written 
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[p/2J 

N = Z d, cos jo). 
j=0 J 

A second obvious case arises when p is even, and 
L = (p- (p/2 ) ,p/2 ) = (p/2, p/2). Then from ( 3 . A. 2 . 3), ( 3 -B.l.l) 
and (3.B.1.2), a^ = p, = 0 and c^ = 1, giving 

2 a L /(a^+b^) = 2 /p, (3-B.1.5) 



which makes no contribution to the hypothesized ratio of 
polynomials. When it is defined, the expression ( 3 .B.I. 5 ) 
will be denoted Bp/ 2 ' 

The general term in the E(2,p) spectrum is 
R = { (p-n,n) , (n ,p-n) } . In this case, with L = (p-n,n) 
and L ' = (n,p-n), we examine the expression 



P 

n 



2a 



L 



2a, 



(af+b^)c L 



(af.+b, , 



2 

'L 



)c 



L ’ 



with a^, b^ and c^ as in ( 3 . A. 2. 3). 

Using (3.B.1.1) and (3.B.1.2) gives 



(3-B.1.6) 



a^ = p + (p-2n) cos (w/2) , 

a L , = p - (p-2n)cos (w/2), (3.B.1.7) 



so that 
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(a 2 +b 2 ) = 2{p 2 -2pn+2n 2 +(p-2n)cos(w/2) } 

(a 2 ,+b 2 ,) = 2{p 2 -2pn+2n 2 -(p-2n)cos (w/2) } , (3.B.1.8) 

n p-n 

c ^ = ( 1+cos (co/2) ) (l-cos(w/2) ) , 



and 



p-n n 

c L | = ( 1+cos ( w/2) ) (1-cos (co/2) ) . (3.B.1.9) 

The common denominator in (3.B.1.6) becomes 

D = {A 2 -B 2 cos 2 (w/2) } {l-cos 2 (u/2) } 
n n n 

222 P“ n 

= {2A-B-B cos (*>}{ (1-cos w)/2) /2, (3. B. 1.10) 

n n n 

using standard trigonometric identities, substituting 
2 2 

A^ = p -2pn+2n and B^ = p-2n, and recalling from (3.B.1.1) 
and (3.B.1.5) that n ranges from 1 to L(p-l)/2j. 

The numerator of (3.B.1.6), with (3. B. 1.10) as a 
common denominator, is 

_ p-2n 

N n = (p+B^cos (to/2) ) ( A^-B^cos (w/2) ) (l+cos(w/2) ) 

p-2n 

+ (p-B cos (co/2) ) (A +B cos (co/2) )(l-cos(co/2)) 
n n n 



N 



n 



+ 



{p+A n +3 n ( A^-p ) cos (w/2)-B^cos 2 (w/2) 



p-2n „ j 

x Z ( p . ^ cos (w/ 2) 
j = 0 ' J ) 



{p+A n ~B n (A n -p)cos ( w/2)-B^(cos 2 (w/2) } 



P"2n ? 

x Z ( P . (-cos w/2) 
j=0 V 0 ' 

lEzln, 

o ? ^ 2 J n . 2j 

= 2{p+A n -B^cos^(to/2) E ( p ~ 2n )cos (to/2) 

l^J 

+ 2{B r (A n -p)} z cos 2 (w/2) . 

J 2- 



(3.B.1 .11) 



Again making simplifying substitutions and invoking 
the appropriate trigonometric identities, (3. B. 1.11) can 
be expressed as 



N = Z d. cos J w. (3. B. 1.12) 

n j=0 J 



Combining (3. B. 1.10) and (3. B. 1.12) in (3.B.1.6) 

gives P = N /D . The next step is to evaluate the summation 
n n n 




Z 

n=0 



P 



n 



P-1 

i _ z 2 

(1-cos 03r n=0 



o/t x n N 

2(1- cos 03 ) n 

{ 2A 2 -B^ ( 1+cos 03 )} 



# ( 3 . B . 1 . 1 3 ) 
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Recall that In ( 3. A. 2. 3) there Is a factor (l-cos u) p 
so that 



|E=3J 

f' p) ( W ) = Q.(2,p) (1 - C °g M)P Z P 
+ A X4 P n=0 n 

I P-1 1 

Q, ( 2 ,p ) L 2 J ~/, c, >n N 
_ A j> 2 (l-cos co ) n 

X4 P n=0 { 2A 2 -B 2 ( 1 +cos u>)} 

n n 



(3.8.1.14) 



Assume p Is even. Then each numerator term, ( 1 -cos a)) n 
is a polynomial in cos w of order (p/ 2 ), n = 0 , 1 , . . . , p/2 - 1 . 
When the (p/2-1) denominator terms are combined into a common 
denominator, the term N q is multiplied by a polynomial of 
order (p/ 2 - 1 ), resulting in a polynomial of order (p- 1 ), 
which is the maximum degree of any of the numerator terms . 
Thus for p even, N ' and M' of the theorem are confirmed. 

Let p be odd. In this case each numerator term 
( 1 -cos w) n N is a polynomial in cos w of degree ((p-l)/2), 
n = 0,1, . . . , (p-l')/2. The product of N with the product of 
the (p-l )/2 denominator terms results in a polynomial of 
degree (p- 1 ), which is the maximum of all the numerator 
terms, and again N ' and M ' are confirmed, thus completing 
the proof of Theorem III.B.l. 

Some specific examples were computed by Lewis et 
al (1973) and the results are shown in Pig. VIII. A. 11. 

III.B.2. The E(4,p) Spectrum 

The construction of the interval spectrum of the 
E(4,p) process is also tediuous, but has value in that a 
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property common to all Erlang superpositions is illustrated. 
That is, if L® and L' 1 ' are members of the same index 
designator set the terms a^p and a^o may have significantly 
different form. For example, let k = 6 and p = 3. Take 
L° = (2,l,0,0,0,0)and L 1 =(2, 0,0, 1,0,0) so that, as in 
(3. A. 2. 3) 



a. o = p-2cos 



( 2tt+o)) 



- cos 



(ijTT+w) 



= p-cos (w/6 ) {2c os (o)/3)^cos (2w/3) } 



+ sin(w/6) {2sin(o)/3)+sin(2o)/3) ) (3-B.2.1) 



and 

^ ( 2 TT+CC ) ( 8tT+0> ) 

a^i = p-2cos- g — - — cos- g— — 

= p-cos ( w/6 ) {2cos (o)/3)+cos ( ^ oj/3 ) ) 

+ sin(a)/6) {2sin(a)/3) + cos (^w/3) ) 

= p-cos (a)/6)cos (a)/3) + sin(a)/6)sin(w/3) . (3-B.2.2) 

The difference between (3.B.1.1) and (3-B.1.2) evolves from 
the identity 



cos ( (2Trj+n)/2n) = -cos (2irj/2n) . 



(3.B.2.3) 
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To construct the E(4,p) interval spectrum, it is 
necessary to identify those terms, a^ , which are distinct. 
Comparison of (3. A. 2. 3) and (3.B.3) reveals that each a^ 
can be represented as 



a^ = p + n^sind/d) + n2cos(w/ i 0 > (3.B.2.4) 



where -p £ n^, n^ £ P and |n^| + | n^ | £ p. A typical set 
of index designators, contains the permutations of the 

non-negative integers d-^^d^djj) • From these permutations 
are derived the terms 



a 



4 



a 






a 



4 



a 



4 



a 



d 



a 



Li 



pid^-l-^sinCw/^ )± 
p±(l 4 -l 2 )sin(w/b)± 
p± (1^-1^) sin (w/^ ) ± 
p± d^-^) sin(to/4 ) ± 
p±(l 2 -l- L )sin(w/4)± 
p±(l^-l^)sin(w/ i l)± 



d^-^) cos (uvd ) , 
(l 3 -l 1 )cos(w/4) , 
(l 3 -l 2 )cos(w/lO , 
(l lj -l 1 )cos(w/ i l) , 
(l i| -l 3 )cos(w/ i l) , 
d 2 -i 1 )cosd/d) , 



j 1 ,...,^, 

j = 5,. ..,8, 

j = 9, ... ,12, 

j = 13,. ..,15, 

j = 17 ,..., 20 , 

j = 21, . . .,24, 

(3.B.2.5) 
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Using (3-B.1.5) is inadequate for the analysis as can be 
seen by looking at two distinct sets of index designation 
vectors R^ = {1,2, 3,4} and R 2 = {2,2,3,3K Denoting 
Lj e R^ by 1 ^ and Lj e R 2 by 2j we have 

2H 8 16 

{a } = {a } = (a ? } 

J=17 J J=1 3 = 9 

This redundancy must be considered when deriving a common 
denominator for (3.A.2.H). 

To relieve this difficulty define the set 
S(p) = {S }, m = 1,2, ... , [(p/2 )-n J , n = 1,2, ... , [p/2j, 
where 

m = (p-2m-n,n). (3.B.2.6) 

Tabulating S(p) gives 



S(p) = { (p , 0 ) , (p-2,0) , . . . ,(p-2 [p/2 J , 0 ) , 



(p-1,1) , (p-3 } (P-2 [(p/2-1 j-1,1) , 



(P- [P/2 J , [p/2 J) } . 



(3.B.2.7) 
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Each element corresponds to a set of ordered pairs 
{(±n lS ±n 2 ) , (±n 2 jtn^j^) } as shown in (3.B.2.4) and (3.B.2.5), 
and each pair (n^n,^) has exactly one corresponding element 
of 5(p), i.e., (|n 1 |,|n 2 |) or (|n 2 |,|n 1 |). 

The special notation developed here for the E(4,p) 
superposition process can be used advantageously to prove 
the following 

Theorem III.B.2: The second order spectral density 

of the E(4,p) process can be written as the ratio of two 
polynomials in cos id as in (3. A. 2. 29), where 



(p 2 +5p-6)/4. 


p = 2,5,6,9,10, . . . 


( p 2 +5p-4)/4. 


p = 3,4,7,8,11,12, 


(p 2 +2p-4)/4 , 


p — 2,4,t,... 


(p 2 +2p-3)/4 , 


P = 3,5,7, .. . 



(3.B.2.8) 



(3.B.2.9) 



Proof: Corresponding to each a^ of (3. A. 2**0 is 

the term 

(a^+b^) = p 2 +n 2 +n 2 + 2p (n^sin(cD/4 )+n 2 cos (id/^) ) . (3.B.2.10) 
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The exact form of (3-A.2.3) is not available 
from the pair (n^n^). This problem Is easily handled in 
the computation of the denominator since the contribution of 
all the c L terms Is p(2' L k (l-cos w)) p as stated In (3. A. 2. 8). 
The problem in the numerator is more complex and will be 
solved indirectly following the construction of the 
denominator . 

It is convenient to partition the set S(p) into 
subsets. Let 

S 1 (p) = {(p,0)} 

S 2 (p) = { (p-2j ,0) , j = 1, . . . ,{(p-l)/2j} 

S^(p) = {(j,j), j = l,...,p/2), p even 

S^(p) = {(0,0)}, p even 



and 



S 5 (p) « S(p) - MS V ( P ) . (3.B.2.11) 

v=l 

First, a denominator will be developed for the 
terms corresponding to particular elements of each of the 
subsets listed in (3.B.2.11). The denominator corresponding 
to S (p) is given by ( 3 . A. 2. 9). S (p) will also have the 
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denominator given by (3- A. 2.9) with p in that expression 



replaced by j = p/2-1 , p/2-2 ,p/2- [p/^J , inclusive, hence 

making no contribution to the denominator. 

2 

A typical term of 5 (p) is (n^O), which from 
(3. B. 2.10) and (3-A.2.3), and using standard trigonometric 
identities, has corresponding common denominator 



II II 

OJ 

IQ 


{p 2 +n^+2pn 1 sin( w/^ } {p 2 +n 2 -2pn 1 sin( u/k ) } 

x{p 2 +n 2 +2pn 1 cos (w/*0 } {p 2 +n 2 -2pn^cos ( w/^ ) } 

o o h 9? 9 h h h h 

(p^+n^) +{ (p^+n^) 2pn^}^+2p n^-4p n^cos w . (3.B.2.12) 




O 

A typical element of S J (p) will yield the common 



denominator 



5 3 ■ 


{p 2 +2n 2 +2pn 1 (sin(to/ 2 0+cos(w/ 1 0 } 

x{p 2 +2n 2 +2pn, [sin(w/4 )-cos (w/4 ) ]} 
x JL 

x{p 2 +2n 2 -2pn 1 [sin(w/ i l )-cos (w/^ ]} 


= 


(p 2 +2n 2 ) ^-{2(p 2 +2n 2 )pn^} 2 +8p i< n^(l+cos w) , (3. B. 2.13) 



again derived from standard trigonometric identities. 
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5 

Finally, a typical element of S (p) yields the 
common denominator 

= {p £: +n^+n2+2p[n 1 sin(w/^ )+n 2 cos (w/^ ) ]} 

x( {p 2 +n^+n 2 + 2 p[n 2 sin(w/ 1 < )+n 1 cos (w/*0 ]} 
x{p 2 +n 2 +n 2 +2p[n 2 sin(w/ i t )-n 1 cos (w/^ ) ] } 
x{p 2 +n 2 +n 2 +2p[n^sin(w/ i < )-n 2 cos (w/^ ) ] } 
x{p 2 +n 2 +n 2 -2p[n 1 sin(w/^ )-n 2 cos (w/^ ) ]} 
x{p 2 +n 2 +n 2 -2p[n 2 sin(o)/ i < )-n^cos(u/ 1 l ) ] } 
x{p 2 +n 2 +n 2 -2p[n 2 sin(w/ i < )+n 1 cos (w/ 1 !) ]} 
x{p 2 +n 2 +n 2 -2p[n 1 sin(u:/ i < )+n 2 cos (o)/*0 ]} 

= {(p 2 +n 2 +n 2 ) - (2p(p 2 +n 2 +n 2 )) (n 2 +n 2 ) 

2i l| I- 2 

+ 2p (n^+n 2 )( 1-cos w)} 

- S^lp^n^n^ (1-cos w) . (3.13.2.1*0 
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The degree of the denominator polynomial, M* in (3.B.2.9), 
is the sum of the degrees of the common denominators for 
each element of S(p). The cardinality of S(p) is 



Similarly 



|S(p)| = 



l p/2 J 

S (j+1) 
j=o 



= < 



(p +6p+8)/8 , p = 2,4,6, 



(p^+4p+3)/8, p = 1,3,5, 



(3.B.2.15) 



|S 1 (p)| = 1 



is 2 (p)I = L(p-n/2j - •> 



p/2-1, p = 2,4,6, 



(P-D/2, p = 3,5,7, 



|s 3 (p) I = 



S 



p/2, p = 2,4,6,..., 



0, P = 3,5,7, . . . , 



|s\p) 



1, p = 2,4,6, ... , 



= < 



0, p = 3,5,7, 
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|S 5 tp)| 



|S(P)| 



4 

I 

v=l 



|S V (p)| 



p (p- 2 )/ 8 , p = 2,4,6, , 



= < 

(p 2 -l)/ 8 , p = 3,5,7,... . 



(3.B.2.16) 



From (3.B.2.12), (3.B.2.13), (3.B.2.14) and 
(3.B.2.16), 



M' 



! S 2 (p ) | (degree(D 2 )} + |S^(p) | {degree(D^) } 
+ | (p) | {degree (D~ ) } 



(p/ 2 -l)+(p/ 2 )+ 2 p(p- 2 )/ 8 . 


p = 2,4,6,.. 


(p-l)/ 2 + 2 (p 2 - 9 )/ 8 . 


P = 3,5,6, . . 


(p 2 +2p-4)/4, 


p = 2,4,6, . . 


(p 2 +2p-3)/4. 


P = 3,5,7, . . 



which is (3.B.2.9) of the Theorem. 

Continuing with the proof, begin analysis of the 
numerator with S^(p). The numerator for this set of terms, 
from (3. A. 2 . 10), ( 3 .B. 3 ) and (3.B.4) is 
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p p p p 

= (1-cos tto/4) ) {( 1-sin (to/4 ) ) + (l-sin(o.'/4) ) } 



p P P P 

+ (1-sin (to/4)) { ( 1+cos (to/4 ) ) + ( 1-cos ( to/4 ) ) } 



[p/ 2j 2 (p+ j ) 2 (p+j ) 

= 2 Z (h {( sin (to/4 ) ) + (cos(to/4)) )(3.E.2.17) 

j = 0 



To show inductively that 



2n 2n [p/2j , 

(cos(to/4)) + (sin(to/4)) = 2 0 . .(cos to) , (3*B.2.l8) 

j-o n;l 



observe from the binomial expansion that 



2n 2n 

(cos(to/4)) + (sin(to/4)) 



n 1 2 j 2 j 

= 1 = 2 f I ? N )[( cos (to/4)) + (sin (to/4)) ] . (3.B.2.19) 

n=0 VJ ' 



For n = 1, 



cos 2 (to/4) + sin 2 (to/4) = 1, 



and for n = 2 



cos^ (to/4 )+sin^ (to/4 ) = l-2cos 2 (io/4) + 2cos it (to/4) 



= (3+cos to)/4. 
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2j 2 j 

Assume that (cos(o)/^)) + (sinCco/ 1 ! ) ) has the form (3.B.2.18) 

for j = 1, . . . ,n . Then 

2n+l 2n+l 

(cos(u/4)) + (sinCco/^)) 



n /n +l\ °* /2 m 

= 1 - Z ( /) Z a. (cos u) , (3.B.2.20) 

j = l V J ' m=0 Jm 

with [n/2j providing the maximum power of cos w in this 
expression . 

Applying this result to (3. B. 2.17) gives 



HI 



W 

Z a. cos jw, 
j = 0 J 



3P/^ , 



W = < 



k (3P-DA 



p = 2,4,6,. . . 

(3.B.2.21) 

P — 3,5,7, •• • 



Placing over the combined common denominator of degree 
M* provides a polynomial of degree 



W = W+M ' 



' (p 2 +5p-6)/4. 



< 



(p 2 +5p-4)/4. 



p = 2,5,6,9,10,13,14,... 

(3.B.2.22) 

P = 3,4,7,8,11,12,... 



To show that N' of (3.B.2.8) is equal to V/' of 
(3.B.2.22), it is necessary to examine the structure of 
(3. A. 2. 27) in light of (3.B.2.9) ana Theorem III.A.l. That 
is, 
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oo 



f,(u>) = E y . cos j OJ 
j=0 J 

N 

E a n cos (nu/4 ) 

= Q X (4,P) ^ • (3.B.2.23) 

E 8* cos mu 



Multiplying the left hand summation in (3.B.2.23) by the 
denominator of the right hand side gives a series in cos jw. 
Since this series is equal to a series in cos(jw/4), it is 
necessary that the only terms with non-zero coefficients in 
the numerator of the right hand side of (3.B.2.23) have 
index j an integer multiple of 4 , by the orthogonality of 
the cosine series. Hence all numerator terms for n not an 
integer multiple of 4 must cancel. It is necessary, then, 
to be concerned only with those terms which will not cancel. 

In particular, the numerator of a given term of 
S^(p) will be 



P_ 

_ {p-n, sinCw/ 1 !) } (1-cos w) D 0 

N = ± 

{p/2+n^+2pn 1 sin(to/^ ) }c 



Prom (3. A. 2. 3) and the derivation of (3. A. 2. 8) it is clear 
that 



P 1 1 1 2 1 3 

(1-cos to) /c = (1-sin w/iJ) (1+cos w/A) (1-sin w/^) 



x(l-cos w/^) 
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where 1^ + 1^ + 1^ + 1^ = 3p . Since it is known that all 
coefficients must vanish except those indexed with integer 
multiples of 4, may be considered a polynomial in cos to 
of degree [(^+3p)/^J • Combining this information with 
(3.B.2.9) shows that the degree of N^, when placed over the 
common denominator for the entire expression, to be 
[ ( ^+3p )/^J +M T -1 which is equal to W* in (3.B.2.22). The 
details of analysis for S V (p), v = 3>^ and 5 lead to the 
same result, thus completing the proof of Theorem III.B.2. 



interval spectrum of an E(4,p) process is that of an 
ARMA(m,n) process with upper bounds given for m and n. 

Some computations are tabulated in Fig. VIII. A. 11 which 
reflect these results. 

III.C. THE DEGREE OF THE SECOND ORDER INTERVAL SPECTRA 
In Section A of this chapter, Theorem III. A. 2 stated 
that the second order interval spectrum of the E(k,p) 
process can be expressed as the ratio of two finite rational 
polynomials in cos to (3. A. 2. 28). It is of interest to 
explore the implications of this theorem. 

For the case in which k is odd, the degree of the 
denominator is bounded by 



It has been established that the second order 




(3. C.l) 
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This can be seen by observing that 




represents the 



total number of distinct terms in (3. A. 2. 2), and it is known 
from Lemma III.A.l that there is no contribution to the 
denominator from the set R^ = {p,0,0, . . . ,0} . 

Again for k odd, the numerator has degree bounded by 
N ' = M ' +p+ L-p/kJ . In (3.A.2.16) it was shown that each set 
R^ could be expressed as the ratio of polynomials of order 
N.+kr-p and N, in cos(co/k). Theorem III. A. 2 guarantees 



that these polynomials can be rewritten as polynomials in 
cos 00 of order [ (N^+kr-p )/kJ and [N^/kJ . From the construc- 
tion Of R - It r>sr 1 hp sppn hhnt M = If ! / f ri ! n | ) Where 




is easily shown that is an integral multiple of k for 
all t as defined in Lemma III.A.l. When (3. A. 2.16) is placed 
over the ensemble common denominator, the numerator becomes 
a polynomial in cos co of order 



The case in which k is even is more difficult. A 
simple formula is not, in general, available. The procedure 
followed in the exposition of Theorem III.B.2 must be 
followed. In (3.B.2.3) it was noted that for k = 2n, 
cos (2tt (j+n)/k) = -cos (2nj/k) . Further, 




n. represents the number of times j appears in R . It 
J t 



l(N t +kr-p)/kJ +(p-r )-LN 1 _/kJ +M* 



= M'+p+[-p/kJ 



(3-C.2) 
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sin(2ir(j+n)/k) = -sin(2irj/k) . Thus, instead of k distinct 
terms, there are n = k /2 distinct terms, each repeated with 
opposite sign. For example, let k = 8 and p = 3 . Let 
L = ( 2, 0 , 0 , 0 , 1 , 0 , 0 , 0 ) . Then a^, as defined in ( 3 . A. 2. 3), 
is 



a L = p-2oosi^i - cos 

= p-COS - . 

Define the set V n (p) to be the set of all non-negative 
vectors of length n satisfying the following conditions: 

1. The elements of each vector are arranged in 
non-decreasing order. 

2. The sum of the elements of each vector plus a 
non-negative even integer is equal to p. 

Each vector v in t/ n ( p ) is analogous to an index desig- 
nator set . For example, if (1,1,3) e 1/^(9), it also 
represents the vectors (1,3»1) and (3»1»1). In the 
notation of (3.A.2.3), these vectors represent 2k values 
of a^ : 

(1,1,3) *• 9±cos(( 2 t r+w)/6 ) ±cos ( ( ^ 71 +w) /6 ) ± 3cos ( ( 6v+u )/6 ) 

(1,3,1) : 9±cos ( ( 2 tt+w)/6)±3cos ( (^tt+w)/ 6 )±cos ( ( 6n+u>)/6 ) 
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(3,1,1): 9±3cos(( 2 tt+w)/6) ±cos ( ( *Jir+to)/6) ±cos ( (6n+w)/6 ) 



Denote the elements of l/ n (p ) by t = 1 , . . . , | l/ n (p ) | . 

Here, |A| denotes the cardinality of the set A. Then the 
degree of the denominator of the interval spectrum is no 
larger than 

K n (p)l 

l l v t |- 2 n 

M' - — ^ ( 3 . C . 3) 

and the degree of the numerator is bounded by 

N' = M'+max{ | (p t | -p)/k +p- |v t j/k|) , ( 3 . C . It ) 

t 

where | | represents the number of distinct values of a ^ 
which are derived from v^. . The difference between (3«C.4) 
and (3-C.2) results from the fact that | v^_ | is not necessarily 
an integral multiple of k. If = (1,1,1) e 1/^(3) , then 
|v t | = 8, which is not divisible by 6. 

Figure III.C.l is a table of N' and M' values computed 
by the method shown in this section for various values of 
k and p. Algebraic computations, discussed in Chapter VIII 
have confirmed actual values to be in agreement with the 
estimates for certain specific cases, but lower values are 
indicated for others. 
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k 

P 


2 


3 


4 


5 


6 


7 


8 


2 


0,1* 


1,2* 


1,2* 


2,3* 


2,3 


3,4 


3,4 


3 


1,2* 


2,4* 


3,5* 


6,8* 


6,8 


11,13 


11,13 


4 


1,3* 


4,6 


5,8* 


13,16 


13,16 


29,32 


27,30 


5 


2,-4 


6,9 


8,11 


24,28 


23,27 


65,69 


56,60 


6 


2,5 


8,12 


11,15 


41,45 


36,40 


131,136 


115,122 


7 


3,6 


11,15 


15,20 


65,70 


41,53 


245,251 




8 


3,7 


14,19 


19,25 


98,104 


74,80 


489,497 




9 


4,8 


17,23 


24,30 


142,149 


108,115 






10 


4,9 


21,27 


29,36 


199,207 


142,150 






Figure 


III. 


C.l Upper 


bound 


estimate 


s for the orders 


of 



the polynomials representing E(k,p) second-order interval 
spectra. The first element of each pair is degree of the 
denominator. The second is the degree of the numerator. 

Those processes marked with an asterisk have been computed 
and are shown in Figure VIII. C. 5- Serial correlation 
analysis of the E(3,5) process indicate the actual degree 
is (6,8) rather than the indicated (6,9). See Section VIII. E. 
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III.D. COMMENTS ON THE MIXED AUTOREGRESSIVE/MOVING 
AVERAGE SPECTRUM 

It has been stated (Theorem III. A. 2) that the second order 
E(kjp) spectrum has the form of a mixed autoregressive /moving 
average process of degree m and n respectively. An Important 
property of a stationary mixed autoregressive/moving average 
process is the relationship of the serial correlations. 

A typical finite ARMA(m,n) process is defined by 



V a i z t-i + 



,+a z, = e.+b n e. n +. 
m t-m t 1 t-1 



,+b e. 
n t-n 



(3.D.1) 



where is the observed value of the process at time t and 
{e^.} is a sequence of independent identically distributed 
random variables with zero mean. -With m > n the serial 
correlations are given by (Box and Jenkins, 1970) 



= a i p k-i + 



. .+a 



m p k-m’ 



k > n 



(3.D.2) 



For the first n lags, p^,...,p n depend jointly on a. , 
j = l,...,m, and b^, i = l,...,n. 

Since the second order spectrum of a stationary inter- 
val process is an unique, invertable transformation of the 
serial correlations, it follows that the serial correlations 
of an E(k,p) process have the above property. Thus, those 
sections of Box and Jenkins dealing with model identifica- 
tion can be applied directly to a data set which is suspected 
of having emanated from an E(k,p) process. Figure III.C.l 



can be used in this respect to assist in determining which 
E(k,p) process might provide the best model. 

Estimation properties for k, p and X of the E(k,p) 
process are unknown. As a result, the statistician must 
apply at once the methodology of Chapter VIII of Cox and 
Lewis (1966) which bases the estimation of p on the variance- 
time curve and the additivity of the counting process in a 
superposition; the results of this chapter regarding inter- 
val series analysis, and the results of Chapter VII of this 
thesis which relate the marginal interval density to the 
number and nature of the component processes. 

III.E. THE SECOND ORDER COUNT SPECTRUM FOR THE 
E (k,p ) PROCESS 

In Chapter II, Subsection A. 2, the second order spectrum 
of counts of a stationary point process is introduced 
following Cox and Lewis (1966, Ch. 4). In subsection 
II. B. 3 , the extension to the count spectrum of the super- 
position of independent stationary point processes was 
given (Cox and Lewis, 1966, Ch. 8). 

For the sake of completeness, a sketch of those results 
is presented here, and applied to the Erlang superposition. 

Recalling (2. A. 2. 5) and (2. A. 2 .6), the asynchronous 
intensity of a stationary (regular) process is m = 1/E[X], 
whe re X denotes the length of an interval following an 
arbitrary event, and the synchronous intensity is m^(t). 
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The intensity function of the synchronous counting 
process generated by the superposition of p independent 
renewal processes is 

m£ P ^(x) = m f (r) + (p-l)m . (3.E.1) 

The count spectrum of a stationary stochastic process 
is 

00 

g + (to) = m{l+ / (m-,(u)-m)e luu du}/Try, to >_ 0 

— oo 

which has the alternative form, due to Cox and Lewis 

g + (to) = m{l+mJ(ito)+m*(-ito)}/Try, (3.E.2) 

* 

v;here m^(s) is the ordinary one-sided Laplace transform of 
m^(t). From (2. A. 2. 6), it is clear that for a renewal 
process 

* f * (s) 

m (s) = - ■— — , (3.E.3) 

f (1-f (s)} 

£ 

where f(t) is the renewal density and f (s) is its Laplace 
transform. Then for the superposition of renewal processes, 
(3.E.2) can be expressed as 
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-GfB 



{ 



l+f*(ioj)f*(-iaj) 

1-f (iw)-f (-iw)+f (iu)f'(-iu) 



= Pg + (w) 



<3 -E. iO 



The spectrum of the E(k,p) counting process is given 
by (3.E.4) with f (s) = (X/(X+s))^, so that 



=f 



0 0 k 2k 

( X^+co ) -X 



s kTTy (x 2 + w 2 )-A k {(X+iid) k +(X-iid) k }+X 2k 




Evaluating ( 3 • E . 5 ) at 0 gives 
g + (0+) = pX/(k 2 ir) . 



(3.E.6) 



10 ? 



IV. SECOND ORDER SPECTRAL ANALYSIS 



OF THE H ( k , p ; q , A ) PROCESS 

The analysis of the last chapter dealt with renewal 
processes with interevent times governed by the Erlang 
distribution. One important property of the Erlang distri- 
bution is that it has increasing hazard rate. That is, if 
X has increasing hazard rate, then ^-{f (t)/R(t ) } is an 
increasing function of t. See Barlow and Prochan (1965) 
for a more detailed discussion of the hazard property. 

Enns (1970) showed that if p iid renewal processes are 
superposed, and the component processes have monotone hazard 
rate, then an arbitrary interval of the superposition 
process has monotone hazard rate. 

It is of interest, therefore, in case one observed a 

superposition of renewal processes in which the times 

between superposed events had a decreasing hazard rate, to 

examine a class of distributions with decreasing hazard 

rate for the intervals of the component renewal process . 

/ 

One such distribution is the hyperexponential which has the 
form of a convex combination of exponential distributions. 
The hyperexponential distribution may be thought of as a 
set of exponentially distributed random variables, the 
choice of which is governed by a discrete probability law. 

(A more general definition has the parameter of the expo- 
nential distribution selected from an arbitrary probability 
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distribution on the positive real line. The definition 
given for this research project is a special case of the 
more general definition.) The tractability of this distri- 
butional form in obtaining an interval spectrum for the 
superposition process comes from the fact that the Laplace 
transform of the pdf, as in the Erlang case, is a ratio of 
rational functions in s. 

Section A is devoted to development of the interval 
spectrum of the hyperexponential superposition process using 
the method described in Chapter III. 

In Section B, the interval spectrum for the H( 2 , 2 :£, X) 
is worked out in detail. 

The count spectrum of the H(2,p;q,A_) process is shown 
in Section C. The complexity of the form of the Laplace 
transform of the hyperexponential pdf precludes in depth 
analysis of either spectral form presented in this chapter. 

IV. A. THE INTERVAL SPECTRUM OF THE H(k,p;q,A) PROCESS 

Following the methodology of Chapter III, Section A, 
the interval spectrum will be determined from the procedure 

<P (z,s) <j> ( z , t ) <f> p (z,t) -* <j> ( p ^(z,s), ( . A . 1 ) 

where <f> ( z , t ) is the generating function of counts for the 
asynchronous component process, and <f> (z,s) is its ordinary 
Laplace transform. The symbols L, and L - '*' denote the 
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Laplace transformation and the Inverse Laplace 
transformation, respectively. 

Let N^(t) be a component asynchronous counting process. 
Denote the survivor function of the interevent times in 
the component renewal processes by 



k 

R(t) = £ q.exp{-A,t}, (1J.A.2) 

j = l 3 3 

k k 

where q. > 0, A. >0, j = l,...,k, and, £ q. = £ A. = 1. 

J J j = 1 J J = 1 0 

Then the superposition of the p iid processes is an H(k,p;£,A.) 
process . 

The Laplace transform of the component interevent pdf 
is 



* 

f (s) 



. f e -st dt 

at 



£q.A.exp{-(A.+s)t}dt 
j=l J 3 3 



£ ( q . A . )/(s+A . ) . 
j = 1 3 3 3 



(H.A.3) 



Prom (3. A. 1.9) 



4>*(z,s) = sE CX]{l-zf (s) )+(z— 1) {l-f (s)> 



s E[X]{l-zf (s)} 






k q,- 



£ tA( 1-z £ 



k q, A 



.1 .1 



J = l X j, 



j=l S + X J, 



(^.A.iO 
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Now, let 



U ( s ) = n (s+X.) 
J=1 J 



and 



H(s) = l q . X . n ( s+X ) , 
j=l J J r^j r 



(4. A, 5) 



so that (4. A. 3) can be rewritten as 



f (s) = H(s)/U(s) . 



(4. A. 6) 



Using (4. A. 6), the Laplace transform of the generating 
function of counts s (4. A. 4) can be written 



* , „ \ _ sE[X] (U (s )--zH( s ) } + ( z-1) {U(s)-H(s) } 



4> (z,s) = 



s E[X]{U(s)-zK(s) } 



= A(s)/B(s), 



(4. A. 7) 



where A(s) and B(s) are defined in the obvious way 
Then Gardner and Barnes (1942) give 



L 1 (<J> (z,s)) = <{»(z,t) 



M 

= £ A(s )exp{s t }/B* (s ) , 

, m m m 



(4. A. 8) 
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where the values s , m = 1,...,M, are the distinct poles of 

m 

£ 

<p (z,s), provided there are first order poles only. No 



effort has been made to determine if, in general, <f> (z,s) 
has only first order poles. This has been the case for 
those specific processes considered. The prime denotes the 

first derivative with respect tos. 

# 

The inversion of <J> (z,s) is not a trivial matter, even 
when provided with the general inversion formula. A more 
manageable approach is presented in Chapter VI, wherein the 
H(k,p;q,A_) process is represented as a semi-Markov generated 
point process with equivalent probabilistic structure. 
Further analysis along current lines will, therefore, be 
restricted to the H(2,2;o_,_A) process. 

IV. B. THE INTERVAL SPECTRUM OF THE H(2,2;a_,A) PROCESS 
The component process residual life distribution for 
time between events is, from (4. A. 2) 



R(x) = q 1 exp{-A 1 x}+q 2 exp{-A 2 x} 



with corresponding Laplace transform 




(4.B.1) 



and expectation 



E[X] = (q 1 A 2 +q 2 A 1 )/(A 1 A 2 ). 



(H .B.2) 
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Evaluating the Laplace transform of the count generating 
function (4. A. 7) in light of (4. A. 6), (4.B.1) and (4.B.2) 
requires tedious but straightf orv. r ard algebra. The result 
is 



# s+l-z(q 1 X 1 +q 2 X 2 ) + X 1 X ? (z-l) (q^^+q X ) 

(j) ( Z j s ) p 

s +s{l-z(q 1 X 1 +q 2 X 2 ) }+X 1 X 2 (l-z) 



s-a+X^Xp ( z— 1 ) / ( < i^^2 +C1 2' > '‘l ^ 
(s-a) (s-b) 



.B. 3) 



where 



a = z(q 1 X 2 +q 2 X 1 )-l, 

B = a 2 -ilX 1 X 2 (l-z) , 
a = (a+B)/2 , 

b = (a-B)/2 . (k.B.H) 

Inverting <p (z,s) using ('A. A. 6) results in 
4>(z,t) = [(2y-a+3)exp{at}-(2y-a-B)exp{bt}]/2 , (4.B.5) 

where 

y = X 1 X 2 ( z-l)/(q 1 X 2 +q 2 X. 1 ) . (^.B.6) 
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Continuing with the procedure outlined in (4.A.1), 



<J> (z,t) = (23 ) [ ( 2y-a+3 ) exp{2at} 

2 

+ (2y-a-3) exp{2bt} 

2 

- 8(y -ya+X 1 X 2 (l~z)exp{a}] , (4.B.7) 

with a, 3> y, a and b as in (4.B.4) and (4.B.6). 

Since a, 3* Y, a and b are independent of t, the Laplace 
transform of (4.B.7) is immediate: 

4>* (2) (z,s) = (23 2 ) [ ( 2y-a+3 ) /(s-2a) 

2 

+ (2y-a-3) /(s-2b) 

- 8{y 2 -ya+l|X 1 X 2 (l-z)}/(s-a)] . (4.B.8) 

Recalling from (3. A. 4) that the interval spectral 
density of a stationary point process is given by 

f ( W) = , (4.B.9) 

(24) (0,0+)-E[X])tt 

* (2) 

the next step is to evaluate <p ( z , s ) at s = 0+, so that 
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<P ^ 2 ^(z,0+) = -2 {a^-2ay+y^+X^X^( 1-z )}/{cx(a 2 -S 2 )} 

(z-1) 2 (A-A 1 A 2 ) 2 +A[z 2 (z 2 -2A+2A 1 A 2 )+z(2A-3A 1 A 2 )+X 1 A 2 ] 

2A 2 A 1 A 2 [(z-1) 2 -Az(z-1)] (H.B.10) 

where 

A = q 1 A 2 +a. 2 A 1 = l-q 1 A 1 -q 2 A 2 . (H.B.ll) 

In Equation (4.B.10), let 

R = A A -2A 3 +A 2 (1+2A 1 A 2 ) + 2AA 1 A 2 +(A- l A 2 ) 2 , 

2 

S = 2A 3 -A 2 (2-3A 1 A 2 )+4AA 1 A 2 -2(A 1 A 2 ) , 

2 2 
T = A^(1+A 1 A 2 )-2AA 1 A 2 -2(A 1 A 2 ) , 

U = 2A 2 A 1 A 2 (1-A) , 

V = 2A 2 A 1 A 2 (A-2) , 

and 

W = 2A 2 A 1 A 2 , (ll.B.12) 

so that 
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( i4 .B . 13) 



,*(2) , AJ \ _ Rz 2 +Sz+T 
<p (z,0+) = — p . 

Uz +Vz+W 

Nov;, making the appropriate substitutions for z in 
(H.B.13), and recalling (if.B.2), (4.B.9) and (4.B.11), 



the interval spectrum of the superposition process may be 



written as 




fj 2) (w) = 


^ ( RV.’+UT ) cos 2a.'+ { V ( R+T ) + ( U+W ) S } cos w +RU+SV+WT 

^ p p p 3 

UWcos 2w+V(U+V/)cos w+U +V +W 

(H.B.lH) 



where 



Q 


= [A 2 X 1 X 2 ]/[2X 1 ,\ 2 -2AX 1 X 2 +A 2 (1-X 1 X 2 )-A 3 ). (4.B.15) 


Beyond 


the observation that the interval spectrum of 



the H(2,2;q^,_X) process is that of an ARMA(2,2) process, very 
little insight is gained from this method of spectral 
computation. Answers to such questions as the nature of 



the serial 


correlation sequence as a function of g_ and X_, 


the effect 


of increased values of k or p, etc., are deeply 


burried in 


the simplifying notation. Further analysis 


along this 


line appears futile. 


IV. C. THE 


COUNT SPECTRUM OF THE H(2,p;o,X_) PROCESS 



Using the procedure of Section III.E, the second order 
spectrum of the counting process is more easily obtained. 
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For simplicity, attention is restricted to the H ( 2 ,p ;q_, X. ) 
process . 

Equations (3.E.6), (4.B.1) and (4.B.2) yield the 
follov.'ing expression for the spectral density of this 
counting process: 

g| p) (w) = pA{A 2 -2(l-X 1 X 2 )+u 2 }/{(A 2 +w 2 )(X 1 X 2 )} , (4.C.1) 

where A is as defined in the set of Equations (JJ.B.ll). 
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V. SEMI-MARKOV GENERATED POINT PROCESSES 



A class of processes which are of direct application to 
this research is that of events marking transitions in a 
semi-Markov process. These processes are studied in this 
chapter. Chapter VI is devoted to describing the Erlang 
and hyperexponential superposition processes as semi-Markov 
generated point processes, and applying the results of this 
chapter. 

In Section A we give the definition of a semi-Markov 
process and univariate semi-Markov generated point process, 
with a brief summary of previous work with regard to this 
model. Section B contains the development of the interval 
covariance function and second order interval spectrum of 
a semi-Markov generated point process. In Section C the 
results of Section B are expanded to the interval trivari- 
ance and bispectrum of intervals, with an indication of 
the method of extension to higher order multivariance and 
spectra . 

The interest in the higher order joint moments and 
spectra comes from the fact that the intervals in a semi- 
Markov generated point process are non-normal; thus the 
process is not completely specified by second order joint 
moments. In examining the higher order moments we hope to 
give a more complete description of the process. 
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V.A . THE SEMI-MARKOV GENERATED POINT PROCESS DEFINED 



A very general definition formulated by Smith (1955) of 

2 

a semi-Markov process has n independent, non-negative 
random variables, S^ , i,j = l,...,n, with distribution 
functions F^.(v), which are sampled in accordance with a 
Markov chain with transition matrix T = (t, . }. At a 

J. <J 

transition time, if the Markov chain makes a transition to 

state i, the next transition is to j with probability t. . 

i J 

and the time between transitions is distributed in 

accordance with ?. . (v) . 

J 

If each transition of the Markov chain is recorded as 
an event in time, the record of events is a semi-Markov 
generated point process . 

In Smith's work, and most subsequent work, the semi- 
Markov process is either a model for a state process, the 
sample functions taking on n levels, or a multivariate 
point process (Cox and Lewis, 1972), i.e., a point process 
v;ith n event types called a Markov renewal process. Here, 
it is used as the source of an interval sequence in a uni- 
variate point process by superposing the marginal processes. 
Cherry (1972) developed the mathematical structure of the 
superposition of two Markov renewal processes as multivariate 
point processes. 

As the mode] of a multivariate point process, it is 
apparent that the sequence of times between successive 
arrivals into state i in a semi-Markov process forms a 
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renewal process for each state 1 = l,...,n. The distinctive 
feature Is that the n renewal processes thus formed are 
dependent. The semi-Markov generated point process is, 
then, a superposition of dependent renewal processes. In 
general, n independent renewal processes form a semi-Markov 
process only if the intervals are exponentially distributed. 

It will be shown in Chapter VI, however, that it is possible 
to construct a semi-Markov generated point process for which 
the probabilistic structure of the (output) sequence of 
events is the same as that of the superposition of finitely 
many Erlang or Hyperexponential independent renewal 
processes . 

For the purpose of this analysis, assume the distribu- 
tions F . (v) are absolutely continuous and have an associated 
density function f^.(v). Using bold face type to indicate 
matrices, denote by F(v) = (f..(v)} the matrix of transition 

-k J 

time densities. Further, assume the non-central moments 

(r) r (r) 

= E[S^j] exist for r <_ R , and let E r = } be the 

matrix of r-th moments. 

It is worth noting at this point that in much of what 
follows, the non-central moments of the random variables 
{S ± i } are all that is required, hence the assumption of 
absolute continuity is unnecessarily strong. The reasons 
for the supposition are to simplify the exposition, to 
ensure that the point process will be regular, and finally, 
that in the applications proposed the assumption is satisfied, 
thus negating a requirement for a more rigorous treatment . 
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Let X be the random variable associated with the m-th 
m 

transition of the Markov chain, for m = 0,±1,±2,.... Thus 
if the m-th transition is from state i to state j , X^ = . 

That is, the residence, or sojourn time in state i, condi- 
tioned on eventual transition to state j . Assuming the 
origin of the sequence {X } was chosen arbitrarily, and all 
states of the chain are ergodic (see Feller, 1968, or 
Kemeny and Snell, I960), then {X^} is a stationary sequence 
of intervals. This fact is most easily seen by observing 
that the transition process is stationary, so that the 
probability of entering a particular state following the 
k-th event approaches a constant as k goes to infinity, 
regardless of the starting conditions. Hence, the finite 

dimensional distributions of (X } are translation invariant 

m 

with respect to the index sequence. 

Example V.A.l A Two State Univariate Semi-Markov 
Generated Point Process . Cox and Lewis (1966, p. 19*0, 
propose the following example of a univariate semi-Markov 
point process : 



T 



a. 



1-a 



1 



1-a, 



a. 



0 £ a 1 ,a 2 <_ 1, 



F ( t ) 



f x (t) 

f 2 (t) 



f x (t) 

f 2 (t) 



t > 0 . 
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This model might describe the failure pattern for a machine 
which receives its spare parts from two sources, each source 
having its own failure time distribution. When = 0, 

an alternating renewal process is generated. 

V.A.l. The Second Order Count Spectrum of a Semi-Markov 
Generated Point Process 

Rudemo (1973) analyzed in detail a special case of 
a semi-Markov generated point process. In the notation of 
this chapter, 



i it j 

i = j, 

and 



V v) = 



X ij exp( -Yi v) - 



(5. A. 1.1) 



t 



ij 



Xlj/ i£j AiJ 



i ¥■ j 

i = j . 



(5. A. 1.2) 



In addition, define the matrix, Q, as the matrix of elements 



( A, 1 > i ¥ J > 

l- n.. , i = j . 

i/j 1J 



(5.A.1.3) 
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The interpretation of is that 

q, , = lira {P . (dt) - P, .(0)}/dt 
J dt+0 J J 

where P^j(t) = Pr{system is in state j at t|state i at 0}. 

That is, q . is the intensity of a transition to state j 
given the system is in state i. 

Assuming the matrix T is irreducible and aperiodic, 
it has stationary vector, m, such that 

it t T = m T . (5. A. 1.4) 



Similarly, define p., the j-th element of o, to be the limit 

J 

as time goes to infinity of the probability that the system 
is in state j; i.e., the probability that the system is in 
state j at an arbitrary time. Then, 

-1 

Pj = {Qj j ( 2 (l/q nn )} . (5. A. 1.5) 



Let the matrix 
infinity, P^ (t ) + p^ , 
rov; is d t . Also, P'(0) 



P ( t ) = {p..(t)J. Then as t goes to 
i J 

and P(«o) is a matrix for which each 
= Q, and 



p h (t) = 



Z P, (t)q , 
in M nJ 



(5. A .1.6) 



where the "prime" is used to denote the first derivative. 
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Finally, Rudemo has determined that the asynchronous 



intensity of an event at an arbitrary time is 
m = g_ T q = TT T P(°°)q , 



(5. A. 1.7) 



and the asynchronous intensity is 



m f (t) = tt t P (t )q , 



(5 .A.l . 8) 



where the vector q = 

Of 7T . 






and 



T 

tr 



indicates 



the transpose 



Having defined and characterized the basic model, 
Rudemo developed a representation for the second order count 
spectrum of the process. Following Cox and Lewis (1966, 

Ch. A), and as given by (2. A. 2. 13), 



g + (io) = ^{l+m f (iw)+m f (-iw) } , w _> 0, 



(5. A. 1.9) 



where 



m f (s) = / e -S l '(m f ,(t ) ) dt . 

o 



From (5. A. 1.7) and (5- A. 1.8) 

oo 

nu(s) = f e -ot ir T (P(t)-P(“) )g_ dt 
o 



12b 



i 



(5. A. 1.10) 



# 

m„(s ) 



T ^ 

TT P 



*(s)a 



where 

oo 

P*(s) = / e _st (P(t) - P(»))dt. 

o 

Some simple calculations will verify that P(°°)Q = 0, 
so from (5. A. 1.6) 



^{P(t)-P(»)} = ( P ( t ) — P (°°) }Q , 



(5.A.1.11) 



giving 



P*(s) = { I-P(°°) } ( Is-Q) . (5. A. 1.12) 

Using (5. A. 1.7), (5.A.1.10) and (5.A.1.12) in (5.A.1.9) 
yields 

-1 -1 

E + (u) = J L t {P(c«) + ( I_P(oo) ) [ ( IojI-Q) + ( — I toi— Q ) ]}q. (5. A. 1.13) 

Two points of interest with regard to Rudemo's work 
as related to this thesis are worth noting here. First, 

Rudemo's definition of a semi-Markov generated point process 
is actually somewhat moi'e general than given here in that he 
permits a subset of states for which transitions are not 
recorded in the point process. This is similar to the 
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methodology in Chapter VI below wherein some states are 
deleted from the state space representation in order to 
reduce the size of the matrices. 

Secondly, the computational procedures presented 
in Subsections VIII. B.l and VIII. B. 2 below for finding the 
inverse of a matrix (Iu-T) can be applied to (5. A. 1.13) 
if a numerical representation of the second order count 
spectrum is desired. 



V.B. SECOND ORDER INTERVAL PROPERTIES OP THE SEMI -MARKOV 
GENERATED POINT PROCESS 

Let T be an nxn stochastic matrix with stationary 

vector as in (5. A. 1.4). Each transition is recorded 

according to its time of occurrence, with times between 

transitions governed by F(u), the matrix of transition time 

densities. Let X. represent the interval following the 

<3 

j-th event, with an arbitrary interval denoted either X 

or X , and ’with S., the time to transition from state i 
o* lk 

to state k in a single step. Let E = {y^^} be the matrix 

r i 1 

of r-th moments for r = 1,2,3,. ..,R. 

Define two new matrices: 

G(u) = (t^f^(u)} represents a matrix of transition 
densities weighted by the Markov probability of the 
transition ; 

= {t^jU^j} represents a matrix of r-th transition 
moments weighted by the Markov probability of the transition. 
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The following results may now be established: 



Lemma V.B.l: The arbitrary interval, X, is governed 

by the pdf 

f x (u) = it T G (u) 1_ (5.B.1) 

where T_ represents an n-vector of l’s. Thus f^Cu) is a 

convex linear combination of the f..(u)'s. 

i J 

CO j 

Define T to be the limit as j ->• « of T° . Then we 

have 



Lemma V. B . 2 : 



E[X] = , (5.B.2) 

Var [X] = )1 , (5.B.3) 

Prom Lemmas V.B.l and V.B.2 we have 
Theorem V.B.l: 

Cov(X t ,X t+J ) = t L t M 1 (T J_1 -T“)M 1 1, j = 1,2,3,..., 

(5.B.H) 



and 
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Theorem V.B.2: The spectral density of the Interval 



process is 

f + U) = i L T {M 2 +M 1 [(Ie i “-T)“ 1 +(Ie“ 1 “-T)’ 1 ]M 1 }l/a 2 , (5.B.5) 

0 < 0) < IT j 



where 



a 2 = Var[X]. 

Proof of Lemma V.B.l: Let v be the state of the 

process following an arbitrary event. Pr{v=i} = , where 

tt^ is the i-th element of tt. The probability that the next 

event marks a transition to state j is t... Thus 

ij 

Pr{X =S . . } = tt . t . . with conditional density f..(u). The 
o ij i U ij 

unconditional density is 

n n 

f n (u) = Z Pr ( v=i ) Z t,.f, .(u) 
u i=l j=l 1J 1J 

= it t G(u)1. (5.B.6) 

This completes the proof of Lemma V.B.l. 

Proof of Lemma 2: The expectation of X is finite since 

it may be no larger than max tVjjK which is finite by 
assumption. Thus Interchange of order in the forma] 
definition using (5.B.6) yields 
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00 



E [ X ] = / uf (u)du 

o 
o 

n n oo 

= Z Pr(v=i) E / uf. .(u)du 



i=l 


j=l 


n 


n 



= Z Pr ( v=i) Z t . .V . 
i=l j=l 10 1J 



= 1 T M 1 1 , (5.B.7) 



which agrees with (5.3.2). 

Similarly , 

E[X 2 ] = tt T M 2 X , hence 

Var [X q ] = tt t {M 2 -M 1 0. . (5.B.8) 

Note that tt t is a nxn matrix each ro w of which is identical 
with tt . Feller (1968, Ch. 15) shows that as j tends to 
infinity tends to_l_7T_ T - T°°, under the assumptions of 
this chapter. Thus 



Var[X ] = tt t (M 2 -M T^M )1 . 

This completes the proof of Lemma V.B.2. 

Proof of Theorem V.B.l: Since { X j } is a stationary 

sequence, write for j > 1 
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Cov(X t ,X t+j ) = Y(J) = E[X q Xj ]-E[X]^ . 



Applying the Chapman-Kolmogorov forward equation (see for 
example Cox and Miller, 1965) the conditional expectation 
of X Q X j . is 




n 

£ t 
i=l 



( 0 - 1 ) 

ki 



n 



£ t 
0 = 1 



i£ y i£ 5 



(5.B.9) 



v;here t£ P ^ represents the probability that the state of the 
system at step p is i given that the state at step 0 was 
k, i.e., the p-th stage transition probability. Note that 
T P = (tf p) ) (Feller, 1968, Ch. 15). 

Unconditioning (5.B.9), 



n n 



E [X X. ] = £ £ Pr (X=S . )E[X X. I X=S , ] 

~ n sk o o sk 



o 0 



s=l k=l 



n 



n 



? nj-n 



= £m £ t , y , £ t, . 

s-l s k-1 sk sk i-1 kl 



n 






= Tr T M 1 T J 1 M 1_ . 



(5 -B. 10) 



Thus , 



Y( J ) = JL T M 1 T j 1 M 1 1 -(t L T M 1 1) 



= I t t m 1 (t j 1 -t co )m 1 i , 



(5-B.ll) 
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which corresponds to (5.B.*!) of Theorem V.B.l, thus 
completing the proof of Theorem V.B.l. 

Proof of Theorem V.B.2: Where it exists, the interval 

spectral density is defined by 

2 

f , (to) = (l+(2/a ) Z y(j)cos jco}/ir, 

0=1 

= (l+(l/a 2 ) Z 7r T M (T J-1 -T to )M, (e la3j +e~ la,J ’ )}/ir, 
0 = 1 

0 < to < tt , (5.B.12) 



with i = \J~-T . 



Let C(z) 



<*> 

Z y(j)z ^ denote the serial covariance 



0=1 “ 

generating function. If Z y(j) < ®, then C(z) < <», 

0 = 1 

0 <_ |z| <_ 1. V.'e first show that the covariance sequence is 

00 

summable, and that lim C(z) = Z y(o)- Then, v. r e show that 

in -1 z+1- 0=1 

(Ie -T) exists for u 2 j rr , j = 0,±1,±2,.... 

The basis for the sunmability of the covariance sequence 
is from Kemer.y and Snell (I960, p. 71).. where it is shown 
that there are constants b and r, 0 < r < 1, such that 



t (v) 

0*k 



" V i 



br 



v 



0 >k 1 , • • • , n , v 1,2, 



(5.B.13) 



Combining (5.B.10), (5.B.11) and (5.B.15) yields 
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Y(j) 



- j/s j.t.k-.k 



n 



n 



n j-i n 



< E IT E t , m . E br J E t.»m „ 
“ S =1 5 k=l sk sk i=l -£=1 l£ iZ 

n 0-1 

= [b E ... E TT s t sk m sk t i£ n i£.^ r 
s,k,i,-l=l 



(5.B.14) 



Clearly, the right hand side of the inequality (5. 3.1*1) 
is a tern of a summable geometric series, hence y(j) is 
absolutely summable. 

From the Lebesque Convergence Theorem (Royden, 19&3 > 

p. 200) if g ( x ) is integrable , | f n ( x ) | < g(x) and f R (x) -* f(x) 

then / f ( x ) = lim St (x). Identifying |y(o)| = g(j)> 

n 

f„(j) = Y(n) (^)j e il1/n and z = (^) J e lj/n , we have 



n 



Z Y(o) ' lira £ = C(l) 

j=l n-* 00 j = l 



(5.B.15) 



It remains to shov/ that ( I e ioJ -T) ^ exists. 



-1 



If the determinant |Ix-T| = 0 then the inverse (Ix-T) 
is not defined. However, |Ix— T| = 0 is the characteristic 
equation for the Markov chain described by T and there are 
at most n distinct roots. Since T is ergodic, x^ - 1 is a 
root, and for all other roots the inequality |x| <1 holds 
(Feller, 1968, Ch. 16). Since |e _i0J | = 1, and for 
a) ¥ 2kiT , k = 0,±1,±2,..., e ¥ 1, e is not a charactei - 
istic value of T for 0 < w < 2 tt , hence (Ie -lw -T) 1 exists. 
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Now, let z = e - ^ w for some 0 < it < 2ir. Then from 
(5.B.11) , 



C(e“ it0 ) = Z it t M (T J ’ -1 -T c °)M 1 l_e it0 

j = l 1 1 



= tt T M 1 { ( Ie it0 -T) 1 -T°°(e it0 -l) 1 }M 1 1 , ( 5 .B. 16 ) 



and 



f + (to) = {l+(l/a 2 )[C(e" iw ) + C(e ia) ) ]}/tt 

= {1+tt_ t M 1 [ ( I e la) -T ) ~ X + ( I e -la) -T ) -1 +T°°]M 1 l_/a 2 }/iT . 

(5.B.17) 

Equation (5.B.15) extends f + (to) to to = 0 and to = 2tt. 

Using ( 5 . B . ^ , 

f + (u) = r T {M 2 +M 1 (Ie ia, -T)" 1 +(Ie" ia, -T)' 1 ]M 1 }I/(o 2 7T), 

which is Equation (5-3.5), thus completing the proof of 
Theorem V.B.2. 

The form of the spectrum is an important part of this 
research. In particular, the form of the interval spectrum 
of a semi-Karkov generated point process is that of a mixed 
moving average-autoregressive process. The following 
theorem states this fact explicitly: 
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Theorem V.B.3: The spectral density (5.B.5) can be 

written as 

J 

E a^cos j 

f + (w) = Q , (5.B.18) 

E 3, cos k 
k=0 k 

where Q, J, K, a., j = 1,...,J and 3, , k = 1,...,K depend on 

J & 

T, M^j and on the size of the state space, n. 

Proof: Examine the form 

t L t M 1 (Ix-T) 1 M 1 = Z (x) . (5.B.19) 

Assuming x is not a characteristic value of T, the inverse 
exists, and Z(x) is a scaler. Inverting (Ix-T) by the 
adjoint method (see for example Finkbeiner, 1966) the adjoint 
elements will be polynomials in x of degree n-i or less. 

The determinant |lx-T| is a polynomial of degree n, so 
(5.B.19) can be written 

Z(x) = {TT T M 1 Adj(Ix-T)M 1 l}/| Ix-T | , (5-B.20) 

which is the ratio of (n-l)th and n-th degree polynomials 
in x, so 



13*1 




(5.B.21) 



Nov; 




n-1 
2 Z 
j = 0 



n 

Z a b cos(j-k) 
k=0 J K 



n-1 n 
2 Z Z 
k=0 £=k+l 



b, b ,>cos(k-£) + Z b. 
K j=0 J 



(5.B.22) 



Substituting (5.B.22) in (5.B.5) with suitable identifica- 
tion of terms results in (5.B.22) which is the spectrum 
of a finite mixed autoregressive-moving average process. 
This completes the proof of Theorem V.B.3. 

V.C. EXTENSIONS TO HIGHER' ORDER SPECTRA 

Defining the trivariance function in a natural way, let 



Then for the stationary sequence of synchronous intervals 
in a semi-Karkov generated point process, we have 



Trv ( X , Y , Z ) = E[{X-E(X)}{Y-E(Y)HZ-E(Z)}]. 



Theorem V. C . 1 : 




) = t( j , j+k) 



= tt_ T M [T* 1 1 M,T 




-2T“)]M 1 1, 



JL 



j ,k > 1 



(5.C.1) 
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Proof: Since the process is stationary. 



E[X r ] = E[X r+J ] = y and 

Trv(X r ,X r+j ,X r+j+k ) = t ( j , j+k) 

= E[(X o -p)(X -p)(X -y)] 

■ (5 - c - 2) 

Arguing as in the proof of Theorem V.B.l, 

E[X 0 XjXj +k ] = I T M 1 T j " 1 M 1 T k ~ 1 M 1 l. (5.C.3) 

Substituting (5.C.3) and (5.3.10) in (5.C.2) yields (5.C.1). 
This completes the proof of Theorem V.C.l. 

Similarly , 

T(j,j) = TT T M 1 [(T J_1 -T 00 )M 2 -2T co M 1 (T j_1 -T C °)]M 1 l , (5.C.H) 

t(0J) = 2L T W 2 T J ~ 1 M 1 -M 1 T 00 [2M 1 T J '' 1 M 1 +M 2 -2M 1 t“m i ]}1, (5.C.5) 

and 

t ( 0 , 0 ) = tt_~ [ M 3 — T (3M 2 -2M 1 T M 1 ) ]T_ . (5.C.6) 
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Rosenblatt and Van Mess (1966) list the following symmetries 
in the trivariance function of a stationary process: 

x ( j ,k ) = x ( k , j ) = t (- j jk- j ) , (5.C.7) 



which indicates that x(j,k) is completely specified by its 
values over any one of the following six sectors along with 
the boundries: 



Section I: 


0 < j < k 


Section II: 


0 


< k < j 


Sector III: 


3 


< 0 < k 


Sector IV: 


3 


< k < 0 


Sector V: 


k 


o 

V 
*r i 

V 


Sector VI: 


k 


< 0 < j 



Define the bispectrum of intervals by 



CO CO 

b(u-,u ? ) = [ Z Z x(j ,k)exp{-iw 1 j-ato ? k}]/[i)iT 2 T(0 > 0)] } 

1 ^ J=-» k=- co x 

-v £ £ tt. (5.C.9) 



In view of (5.C.8), (5.C.9) can be expressed in terms of 
sector I values only: 
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00 00 -i( (w 1 +co 0 ) j+co_k) -i( (w +co„) j+u. k) 

b(u ,w ) = { E E x(jj+k)[e 1 d 1 +e 1 . 1 

1 ^ j=l k=l 



i( (u 1 +w 2 )k+u 2 j ) i( (to 1 +to 2 )k+co 1 j )• -iCka^-ja^) iCju^-ku^) 

+ e +e +e +e ] 



“ -iw 0 «j -ico j i(to +co_)j 

+ E t ( 0 , j ) [ e ^ +e 1 +e 1 d ] + x(0,0) 
j = l 

00 +iw,j iw j -i(io +to 0 )j 5 

+ £ x(j,j)[e +e +e ] }/ ( 4-rr^x (0,0) (5.C.10) 

j = l 



To evaluate (5.C.1C) in view of (5.C.1), (5.C.5), (5.C.6) 
and (5.C.7), the following formulae v:ill be useful. For a, 

“3. — t) 

b such that e , e <1 and not characteristic values of T, 



E 


E T : 1 M T k 1 e _aj ' bk = (Ie a -T) ^.(Ieh-T) - 1 , 


(5.C.11) 


«J = 1 


k=l 1 1 




CO 


OD 




E 


I e- aJ - Sk = (e a -l) -1 (e b -l) -1 , 


(5.C.12) 


J=1 


k=l 




CO 


OO 




E 


E T jl e~ aj '" bk = (e b -l) _1 (Ie a -T) -1 , 


(5.C.13) 


3=1 


k=l 




CO 


OO 




E 


E jJ +k- 1 e -aj -bk = T ( i e a -T) -1 ( i e b _T) -1 } 


(5-C.lU) 



j=l k=l 



Let x (a,b) 
(5.C.1), (5.C.U) 
(5-C.liJ), 



OO CO 

E E x(j,k+j)e" aJ - bk . Then from 
j=l k=l 

through (5.C.7) and (5.C.11) through 
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x*(a,b) = 7T T M 1 {(Ie a -T) _1 (Ie _b -T)" 1 -T 0 °N 1 [(e b -l)" 1 (Ie a -T) _1 
+ (e a -l)“ 1 (Ie b -T) _1 +T(Ie b -T) _1 (Ie a -T) _1 
- 2T c °(e a -l) _1 (e b -i)' 1 ]}M 1 I • (5.C.15) 

Let 

x (a) = I x ( j , j )e 

3=1 

= 7T T M 1 {[(Ie a -T) _1 T c °(e a -l)" 1 ]M 2 
- 2TM 1 [(e a -l)~ 1 T C °(e a -l)" 1 ]M 1 }l (3.C.16) 

and 

t (a) = Z T(0,j)e _aj ' 

° j = l 

= ii T M 2 (Ie a -T)~ 1 M 1 l-2 IL T M 1 T CO (Ie a -T)' 1 M 1 l 

-jT T {M 1 T ro M 2 l(e a -l)~ 1 +2M 1 T co M 1 T 0o M 1 l(e a -l)' 1 } (5.C.17) 

Finally, substituting (5.C.15), (5-C.16) and (5.C.17) 
in (5.C.10) gives the result 
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77 ' Tv Tv 

b(aj 1> w 2 ) = {x ( (a) 1 +w 2 )i ,w 2 1)+t ( (w^+w 2 )i ,u^i)+T ( -w^i , - ( w., +w 2 ) i ) 

* * * 

+ x (-w^i j-(w^+w 2 )1)+t (-w 2 i jto^i)+T (w^i,-w 2 i) 

+ t ( (co^+u 2 )1)+t' (-w^1)+t' (-w 2 i)+x (0,0) 

+ T 0 (“ (w 1 + C0 2 )i) + T o (w l i)+T 0 (w 2 i) } / ( ^ TT 2 T (0,0) ) (5.C.18) 

The existence of b(to-^,to 2 ) is shown in a manner similar 
to that in the proof of Theorem V.B.2. 

In general, n-th order spectra are defined as Fourier 
transforms of functions of n-th order joint moments, fre- 
quently cumulants (see Brillanger, 1965 3 1972; Tukey , 1959)- 
The key step in determining the n-th order spectrum of any 
moment function is to observe that, that for this process, 



E[X X X ., ] 

o j x+k 



= 1 M 1 ...M 1 T k 1 )M 1 1, j 



k = 1,2,3,... 

(5 .C .19) 



and 



E[X. . .X , , . . .X , , ] 
v+j s+k 



- J1 T M 1 ( . . .T J 1 M r . . .T k 2 )M 1 1 



(5.C.20) 
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Thus the joint interval structure is completely characterised 
in terms of . . . } M^ and T, with spectral representation 

depending on the choice of moment function. 

It may be observed at this point that the joint inter- 
val distributions are directly accessible. Referring to 

Lemma V.B.l, we see that the arbitrary interval density is 

2 

a linear combination of the n transition densities. Com- 
bining this idea with the construction of (5.C.19) gives 
the result 

f o , j ',k (u u ,U 2 ,U 3 ) = ^ T G(u 1 )T 1_1 G(u 2 )T k " 1 G(u 3 )I , (5.C.21) 

where f . , (u,v,w) represents the joint density of the 
o > 3 > ‘ r - 

intervals 0,j and j+k. This result can be generalized to 
any combination of intervals. 



VI. THE ERLANG AND HYPE REX POME! JTIAL SUPERPOSITION 

PROCESSES AS SEMI-HARKOV GENERATED POINT PROCESSES 

In Chapters III and IV, the nature of the spectral 
representation of Erlang and hyperexponential superposition 
processes was examined. The algebraic manipulations proved 
difficult and unweildy for all but the simplest processes. 

In this chapter, the "method of stages" is exploited to 
derive semi-Markov generated point processes which are 
equivalent with the Erlang and .hyperexponential super- 
position processes. 

In addition to the computational savings resulting from 
the semi-Markov representation, higher order spectral 
estimates become feasible. The development of higher order 
spectra is desireable because the various processes are not 
uniquely defined by second order spectra which are indis- 
tinguishable from those of a stationary mixed autoregressive/ 
moving average process. Higher order joint moments are not, 
in general, available for the general superposition of iid 
renewal processes, but can be determined for the Erlang and 
hyperexponential superpositions by means of the semi-Markov 
modeling described below. In Section A the E(k,p) process 
is shown to have an equivalent semi-Markov generated point 
process representation. Independence beyond the first lag 
is shown for the E(2,2) process, and computational considera- 
tions are discussed with regard to determining the matrices 



T and of Chapter V for the general E(k,p) process. 

State space reduction and compression receive special 
attention . 

Section B is devoted to the modeling of the H(k,p;q,A.) 
process as a semi-Harkov generated point process. 

VI. A. THE E(kjp) PROCESS AS A SEMI-MARKOV 
GENERATED POINT PROCESS 

Let Y = X 1 +X 2 +. . .+X k , where Pr[X^>x] = e~ Xx . Then Y 
has the probability density function 

f y (y) = X k y k “ 1 e _Xy /(k-l) ! 

= Y y (k,X) . 

This well known fact that the sum of k exponentially 
distributed random variables has the Erlang distribution 
is the key property which allows the modeling of an Erlang 
superposition process as a semi-Markov process. 

In the "method of stages" the random variable Y is 
thought of as proceeding through k stages, the delay times 
independent and with identical exponential distributions 
over all stages. A realisation of Y occurs upon termination 
of the k-th stage. Y is said to be in stage i at t if 



x 1 +x 2 +. . ,+X^t 



x 1 +x ? +. . . +X 



i+1 



>t 



1'I3 



and 



Assume that p independent renewal processes with 
identical Erlang inter-event distributions are observed 
concurrently. A state space can be defined in the 
following way: 

Designate each process as process i, i=l,...,p, and 
denote the current stage of process i by s^=l,...,k. Then 
define the state space 

■S — {(s^j*.*>Sp)} 

as the set of all combinations of stages. 

A transition occurs whenever a component process 
advances one stage and each component process cycles 
repetitively through stages 1 , . . . ,k , 1 , . . . ,k , 1 , . . . A renewal 
event occurs in process i whenever it makes the transition 
from s.=k to s.=l. 

l l 

Note that in this formulation direct transitions are 
possible from s°=(s? ,. . . ,s“) to s 1 = (s. 1 , . . . , s M only if for 

— 1 ^ “ 1 P 

some i=l....,D (s°+e.) . .^s 1 , where e. is a vector of 

zeroes except for a one in the i-th position. 

In this particular formulation, transition times are 
the same for all transitions. Because of the lack of memory 
property of the exponential distribution, if the system is 
observed at any time, the time to the next stage in any 
process has the residual life distribution R(t) = e - ^ . 

The next transition is the minimum over the p processes of 
the time to the next stage. Thus the time to the next 



transition in the superposition process has the residual 
life distribution R^ p ^(t) = e -p ^' / . Clearly, the process 
which actually advances is process i with probability 1/p, 
since we assume that the component processes are identically 
distributed and independent. 

Example VI. A. 1. The E(Z 3 2) process. Let k=3 be the 
shape parameter of the Erlang renewal distribution, and let 
p=2 be the number of component processes. The state space 
is 



S={ (1,1) ,(1,2), (2,1), (2, 2), (3,2) ,(2,3), 
( 3> 3) > ( 3,1 ) > (1 > 3) } • 



(6 . A . 1 ) 



Figure VI. A. 1 shows a network of possible paths of the 
Markov chain through the state space. When the process 
enters a state enclosed in a box, a component process event 
occurs, and the process continues as from the circled state 
of the same number. 

Recalling that the residence time in any state has 
residual life distribution R^ p ^(t) = e~ p ^ , observe that if 
the process is in state (1,1), there are two paths by which 
the process can leave and reenter that state without any 
intervening events. Since each branch from the state is 
chosen v/ith probability 1/2, the probability that a particula 
path is chosen is 2 -n , where n is the length of the path. 

Thus the lower branch from (ll) to 



11 



will be realised with 



_q 

probability 2 . Given that a particular path is chosen, the 




Figure VI. A. 1 Transition network for the E(3>2) process. 
Times of transitions into states enclosed in boxes are 
recorded as events in the point process. The transition 
process continues from the circled state with the same 
index pair. 
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time until the next event is governed by the density 

Y t (n,pX) = (pX) n t n_1 e" pXt /(n-l)! (6. A. 2) 

In this example, if the process is in state (1,1), the 
probability that the next event is associated with a 
transition back into state (1,1) is 

Pr[(l,l) : (1,1)] = 2(1/8) = 1/4 , 

while the time until the next event, given that it represents 
a return to (1,1) is governed by Y t (3,2A) with expectation 
3/2A. The colon is used to denote a direct transition 
between the states indicated. 

We will return to this example on several occasions to 
clarifty the development. 

VI . A . 1 . Reduced State Space, S r 

Since the superposition process events are associated 
only with certain transitions, it is desireable to focus 
attention on a subset of the state space. A new process may 
be defined which has as a state space those elements of S 
which correspond to at least one component process being in 
stage one . 

Example VI. A. 1 (continued). In the E(3,2) process, 
the reduced state space, denoted S r , takes the form 

S r = {(1,1) ,(1,2) ,(2,1) ,(3,1) ,(1,3)) . 
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InS, (6. A. 1.1), the path [ (1,1) : (1,2) : (2 ,2) : ( 3,2) : (1 ,2) ] 

In Figure VI. A. 1 would correspond to the transition 
[ (1 , 1 ) : ( 1 ,2 ) ] in the reduced space, S r . Transition tine 
would be governed by y t (^,2A). Transition probability is 

Pr[(l,l) : (1,2)] = N/2 4 , 

where N=3 is the number of paths in S starting in state 
(1,1) and terminating with an event in state (1,2), having 
no intervening events. 

Continuing with the general presentation, there are 
two advantages to the use of the reduced state space, S . 
First, the cardinality of S is |S|=k p . Although |S r | grows 
rapidly with k and p, it is much smaller. An expression for 
|S r | is not given because it is rather complicated, and the 
next step in the state space reduction process renders it 
unnecessary. The main value of state space reduction is 
that if the transition pattern in the reduced state space 
has retained the Markov property, then by considering the 
transition times in as events in a point process, we have 
a semi-Markov generated point process as defined in Chapter 

Clearly, the Markov property is retained through the 
reduction process. That is, the transition probabilities 
associated with any state s in S are independent of the 
evolution of the state space prior to entering s. 



• VI . A . 2 . Transition Probabilities in 



Examine the direct transition in S from 

r 



u° = (s^ , . . . , Sp ) to u 1 = (s| , . . . > s ^_i ,1) . This transition 
corresponds to a path in S 




(6. A. 2.1) 



with all intervening states v 1 , i=l 



r-1, satisfying the 



inequality 




(6. A. 2. 2) 



where it is understood that the inequality holds for each 
element cf the vectors. The inequality condition (6. A. 2. 2) 
precludes an intervening event in the path (6. A. 2.1). 

Recall that in S, the choice of the state following 
any initial state is an event of probability 1/p. The 

n X 1 ™~ 1 

number of transitions from v to v is 



(The process p was chosen arbitrarily as the source of the 
event. Any other process would have the same property, but 
would be more cumbersome notationally . ) The number of paths 
in S satisfying (6. A. 2.1) and (6.A.2.2) is given by the 
multinomial coefficient 



P-1 

r-1 = z (s!-s.) + (k-s) 
J= 1 2 J P 



(6.A.2. 3) 



1*19 



N 



(r-1) ! 



(6. A. 2. 4) 



P-1 

{ n ( s ! -s . ) ! } (k-s ) ! 

j=l J J p 

Combining (6. A. 2. 3) and (6.A.2.*J), and noting that 

3 ° — 1 

Pr[v :v] = 1/p gives 

Pr[u° ru 1 ] = N/p r . (6. A. 2. 5) 

Further, the transition time associated with this event is 
governed by 

f u o. u i(t) = Y t (r,pA) (6. A. 2. 6) 

since (u°:u a ) represents r realizations of iid exponential 
(pX) random variables. 

Example VI. A. 1 (continued). In the reduced state 
space, S , associated with the E(k,p) process, the matrices 
of transition probabilities and transition time densities 
can be developed using (6. A. 2. 5) and (6. A. 2. 6). These 
matrices are shown in Figure VI. A. 2 and Figure VI. A. 3 
respectively . 

VI. A. 3. The Collansed State Space, S 

Study of Figures VI. A. 1, VI. A. 2 and VI. A. 3 reveals 
a degree of symmetry which suggests a further reduction in 
the size of the state space. In particular, it is possible 
to treat all permutations of a set of permissible stage 
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( 11 ) 



( 12 ) 



( 21 ) 



(13) 



(3D 



(11) 


(12) 


(21) 


(13) 


( 31 : 
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IF 


IF 


IF 
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3 


3 




IT 
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IF 


IF 


1 
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3 
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I 
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IF 
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1 


n 


l 


1 


1 


2 
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F 


F 
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l 


l 


2 


IT 


0 


F 


F 



Figure VI. A. 2 Transition matrix for the E(3,2) process; 
Reduced state space (S ) 

The states are denoted (ij). A matrix element is the 
probability the next "boxed" state (See Fig. VI. A. 1) 
entered is (ij ) given the previous "boxed" state is (kn) . 
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( 11 ) 



( 12 ) 

( 21 ) 

(13) 

(31) 



( 11 ) 

Y t (3,2X) 
Y t (2 } 2X) 
Y t (2,2X) 
Y t (l,2X) 
Y t (l,2X) 



( 12 ) 

Y t (4,2X) 

Y t (3,2X) 

Y t (3,2X) 

0 

Y t (2,2X) 



( 21 ) 

Y t (^,2X) 
Y t (3,2X) 
Y t (3,2X) 
Y t (2,2X) 
0 



(13) 

Y t (5,2X) 

Y t (4,2X) 

Y t (^,2X) 

Y t (3,2X) 

Y t (3,2X) 



(3D 

Y t (5,2X)' 

Y t (^,2X) 

Y t (^,2X) 

Y f (3,2X) 

Y f (3,2X) 



Figure VI. A. 3 Transition time densities for the E(3,2) 
process; reduced state space (S r ) 

The state representation is as in Fig. VI. A. 2. Given that 
the system has just entered state (kn) and the next "boxed" 
state (Fig. VI. A. 1) is (ij ) , the time of transition will be 
governed by the Erlang density indicated. 
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values as a single state denoted by a generic element. 

Thus w={(Sp . . . ,Sp)} would represent all states of which 

are distinct permutations of the elements of w. The collapsed 

state space is S , the partition of S defined by the sets w. 

c r* 

The states of S will be denoted by lower case script letters 
indicating their roles as sets of states from S . States 
of S r will still be referred to in vector notation as 
underlined lower case letters. 

In Example VI. A. 1, S c ={ 1,1 , 1,2 , 1,3 ). 

The cardinality of S is given by 




■( 



k+p-2\ 

P-1 / 



(6. A. 3-1) 



the figurate number for k types of elements taken in sets 
of size p-1. Figure VI. A. h compares |S| with | | for k and 
p taking values 2 through 5. 

To be useful in view of the results of Chapter V, 
transitions ’within the collapsed state space, S , must 
exhibit the Markov property. That is, it is necessary to 
show that S r with its transition probability matrix, T r , 
is a lump able Markov chain with respect to the partition S . 

Following Kemeny and Snell (I960, Ch. *0 , a Markov 
chain, C, is said to be lump able with respect to a partition 
A={A^ , . . . ,A^} if for every starting vector it_, the lumped 
process is a Markov chain with transition probabilities 
independent of it. A necessary and sufficient condition that 
C be lurnpable with respect to the partition A is that for 
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p 

k 


2 


3 


4 


5 


2 


4 


8 


16 


32 


3 


9 


27 


81 


243 


4 


16 


64 


256 


1024 


5 


25 


125 


625 


3125 



Table of |S| = k P 



P 


2 


3 


4 


5 


k 










2 


2 


3 


4 


5 


3 


3 


6 


10 


15 


4 


4 


10 


20 


35 


5 


5 


15 


35 


70 






Table of |S c | = 1 


(vn 





Figure VI. A. 4 Comparison of state space si r.e for the F.(k,p) 
representations S and S . The dimension of the stage 
transition Markov chain C is |S| = k* 3 . The dimension of the 
reduced, collapsed state space is /k+p-2\ 

|S C | =\ k-l ) 
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every pair of sets A , A., pr{n:A } = Z Pr{n:m} has the 

1 J J . meA . 

same value for every state n contained in^A^,. These common 
values, form the transition matrix for the lumped 

chain , A . 

Formally, we state 

Theorem VI. A. 1: The Markov chain is lumpable 

with respect to the partition S . 

Proof: It is sufficient to show that 

•Pr[u=(s-^, . . . ,Sp) :w={s^, . . . ,s^} ] = constant 

for ue{ (s 1} . . . ,s ) } . 

First, let u and w be generic names of elements of 

S Q and assume that a direct transition from a to to is 

feasible in S . That is, there exist elements u and w in u 
r — — 

and to and a path in S, (u: v^: . . . : : w) satisfying the 
inequality (6. A. 2. 2). Further, suppose process m is that 
process which records an event in the transition from u to 
w. Then the number of steps from u to w is given by 
(6 . A. 2 . 3) as 

r = Z (s’-s . ) + (k+l-s ) 
j/m 0 J m 

P P 

= Z s' - Z s +1 , (6. A. 3.2) 

j=l J J=1 J 

since s'=k by construction. Thus, the number of transitions 

m y 
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in S corresponding to a transition from an element of u to 
an element of u> is independent of the elements chosen. 

Hence , 

Pr[u.:tc] = N i /p r , i = l,...,n, (6.A.3.3) 

where is the number of distinct paths in S satisfying 
(6. A. 2. 2) beginning at u^ and terminating at an element of 
w. Here, n represents the number of distinct permutations 
of the elements of u. 

Let N. . be the number of paths from u. e u to 
U -i 

w. e w, where again process m has recorded the transition 
J 

event . Then 




(n-1 ) ! 



{ it 



(s'. -s . ) ! } (k-s 
J J m 




1 ,.«.,t, a a , . . . , n 

(6. A. 3.-4) 



and 



t 

W. = EM., 
1 j=i 1J 



(6. A. 3. 5) 



where t is the number of distinct permutations of w . 

¥: # # 

Let u i = (s^,,.. 3 s ) be any other element cf a. 



Then there exists a one to one mapping, h, of u ^ , onto u^ 

* * * * 
such that h(Sj) = s^. Then a new element Wj = (sj,...,s^) 

* * 

is formed from h(s') = s|. It follows that N. . = and 

# 

= H(u,cc). Hence the lumpability condition is 
satisfied, thus completing the proof of Theorem VI.A.l. 
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The transition probability matrix for the collapsed 



state space is 



T = {Pr[u :w] | u,weS } 



{£ Pr[u:w]|u,ioeS } . 



view 



( 6 . A . 3 • 6 ) 



The transition time density matrix is 



F(t) = { Y t ( N ( ct , to ) ,pX) | u,weS c > 



(6.A.3.7) 



Returning once more to Example VI. A. 1, Figures VI. A. 5 and 
VI. A. 6 shew the matrices of transition probabilities and 
transition densities, extracted from Figures VI. A. 2 and 
VI. A. 3. For example, 

Pr[U,2), {1,2}] = Pr [ (1 , 2 ) : (1,2)] + Pr[(l,2): (2,1)] 

= 3/8 

VI.A.3.a. Proof of Theorem III. A. 2 

Theorem III. A. 2 claimed the interval spectral 
density of an E(k,p) process is expressible as the ratio of 
finite, rational polynomials in cos w. Theorem V.B.3 showed 
the same result for the interval spectral density of a 
univariate semi -Harkov generated point process. In this 
section it has been shown that an E(k,p) process has an 
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{ 11 } 



{ 11 } { 12 } { 13 } 

I 1 3 3l 

¥ ff H 



{ 12 } 



13 3 

¥ TJ F 



{13} 



3 



* 



Figure VI. A. 5 Transition matrix for the E(3 S 2) process ; 
collapsed state space (S c ). 

The states are denoted { i j } to indicate their functions as 
sets of states in S r . That is { i J } = { (i.j ) , ( j i ) } . As in 
Fig. VI. A. 2, transitions represent movement between 
"boxed" states in Fig. VI. A. 1. 
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{ 11 } 



( 21 ) 



( 11 ) 

{ 12 } 

{ 21 } 



Y t (3,2A) 

Y t (2 } 2A) 

Y.(1,2A) 

L/ 



{ 12 } 

Y t (^,2A) 
Y t ( 3 j 2 A ) 
Y t ( 2 j 2A ) 



Y fc (5 j 2A ) 
Y t , 2A) 
Y t ( 3 , 2A )/ 



Figure VI. A. 6 Transition tine densities for the E(3 5 2) 
process; collapsed state space (S c ). 

State space representation as in Fig. VI. A. 5- 
Interpretations of entries as in Fig. VI. A. 3. 
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equivalent representation as a semi-Markov generated point 
process, thus establishing Theorem III. A. 2 as a special 
case of Theorem V.B.3* 

VI . A . . The E(2,2) Process as a Semi-Markov Generated 
Point Process 

Let 1L ( t ) , i = 1,2 be a point process with indepen- 
dent identically distributed intervals governed by the 
Y t ( 2 , A ) density. Let N(t) = N^t) + N 2 (t) denote an E(2,2) 
counting process. N^(t) may be thought of as a Poisson 
process in which only alternate events are recorded. Con- 
sider the process N^(t) to be in stage one if its next 
event will not be recorded, and stage two otherwise. Events 
in the superposed process, N(t), will occur whenever either 
contributing process makes a transition from stage two to 
stage one . 

Define the states of the semi-Markov process by 

(i,j) = { N ^ ( t ) is in stage i; N 2 (t) is in stage j } , 

1,0 = 1 , 2 , 



so that the entire state space is 

S = {(1,1), (1,2), (2,1), (2, 2)}. 

Assume that at some time the process is in state 
(i,j). Let and V 2 be the times to the next transition 
in processes 1 and 2 respectively. Then, by hypothesis, 
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and are lid obeying the exponential probability law 
with rate A. Component process 1 will advance before com- 
ponent 2 if < V 2 5 an event probability 1/2. The 
time until the next transition will be V 55 mintV^jV^} 
which is distributed exponentially at rate 2A. 

Transitions within the chain S follow the pattern 
illustrated in Fig. VI. A. 7. From any state, one of two 
paths will be chosen with equal probability. Transitions 
to the left result in events of N(t). The possible tra- 
jectories from each state terminating in a main process 
event are enumerated in Fig. VI. A. 8. 

The reduced state space of the E(2,2) process is 

S r = {(1,1), (1,2), (2,1)}. 

The transition matrix for the reduced state space may be 
derived from Fig. VI. A. 8. For example, 

Pr[(l,l): (1,1)] = Pr[trajectory 1] + Pr[trajectory 2] 

= 1 / 2 . 

Similarly, the matrix of transition time densities may be 
taken from the table of Fig. VI. A. 8. Figure VI. A. 9 lists 
the transition probability and interval density matrices. 



l6l 




"Figure VI. A. 7 Transition network for the E(2,2) process. 
Transitions to the left result in events recorded in the 
point process. Transitions to the right do not have 
corresponding events. 
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No. 


Trajectory 


Probability 


Distribution 


1 


(11) : (12) : (11) 


1 

F 


Y t ( 2 , 2A ) 


2 


(11):(21): (11) 


1 

F 


Y t (2,2A) 


3 


(11) : (12) : (22) : (12) 


l 

F 


Y t (3,2X) 


H 


(11) : (12) : (22) : (21) 


l 

F 


Y fc ( 3 , 2A ) 


5 


(11): (21): (22): (12) 


1 

F 


Y fc (3,2A) 


6 


(11) : (21) : (22) : (21) 


l 

F 


Y t (3,2A) 


7 


(12) :(11) 


1 

2 


Y t (l,2A) 


8 


(21) : (11) 


1 

2 


Y t (l,2A) 


9 


(12) : (22) : (12) 


1 

If 


Y fc ( 2 , 2A ) 


10 


(12): (22) : (21) 


1 

F 


Y t (2,2A) 


11 


(21) : (22) : (12) 


1 

F 


Y t (2,2A) 


12 


(21) : (22) : (21) 


1 

F 


Y t (2,2A) 


13 


(22) : (12) 


1 

2 


Y t (l,2A) 


111 


(22) : (21) 


1 

2 


Y fc ( 1 j 2 A ) 


Figure VI. 
process . 


.A. 8 Stage transition 
This is an enumeration 


trajectories in 
of all traject 


the E ( 2 , 2 ) 
cries from 



any state in the stage transition system, S, terminating 
v.’ith an event in the point process (a transition to the left 
in Fig. VI. A. 7). The probability and distribution columns 
are conditioned on knowledge of the initial state. 



163 



( 11 ) 



( 12 ) 



( 21 ) 



(ID 

( 12 ) 

( 21 ) 



1 1 

TT ¥ 

1 1 

2 ir 

1 1 

2 ¥ 



Transition Matrix 






1 

IT 

1 



( 11 ) 



( 11 ) 



( 12 ) 



( 21 ) 



(11) 


V 2 


,2X) 


Y t <3 


,2X) 


Y t ( 3 > 2X ) 


(12) 


V 1 


,2X) 


V 2 


> 2X ) 


Y t (2 ,2X) 


(21) 


V 1 


> 2X ) 


V 2 


> 2X ) 


Y t (2 > 2X ) 



Transition Tine Densities 



Figure VI. A. 9 Reduced state space (S ) matrices for the 
E(2,2) process. 

Interpretations of these matrices are as in Figures VI. A. 2 
and VI . A . 3 . 



16<I 



Finally, lumping states (2,1) and (1,2) forms the 
collapsed state space 



S c = ({1,1}, (1,2)} 

with transition matrix 



(6. A. 4.1) 



T = 



1/2 1/2 

1/2 1/2 



(6. A. 4 .2) 



and interval density matrix 



F ( t ) 



Y t (2,2A) Y t (3,2A) 

Y t ( 1 , 2 A ) Y t (2,2A) 



(6. A. 4. 3) 



Clearly, the stationary vector of T is 



tt t = (1/2, 1/2) 



(6. A. 4. 4) 



From Lemma V.B.l, the density of an arbitrary 
Interval is 



f Q (t) = TT T F(t)J 



= {Y t (l,2)+2 Yfc (2,2)+Y t (3,2)}/4. 



( 6 . A . 4 . 5 ) 
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In Chapter VII, this result is shown to be the same as that 
derived from the expression for the density of an arbitrary 
superposition interval. 

Lewis, et al (1973) showed that for the E(2,2) 
process, the serial interval covariance vanished for lags 
greater than one. The semi-Karkov representation admits 
the following 

Theorem VI. A. 2: Let X be the n-th interval in an 

n 

E(2,2) process, n = 0,±1,±2,.... Then X is independent 

of all realizations X., j < n-1 . That is to say 

J 



PHX n it|X n - 2 




tg , . . . } = Pr{X n <t } 



Proof: The interval X - was terminated by the transition 

n-2 

of one of the component processes from stage 2 to stage 1 
putting the system in state (1,1), (1,2) or (2,1). Simi- 
larly, the interval X^ will begin with the system in state 
(1,1), (1,2) or (2,1), i.e., states {1,1} or {1,2} of S c> 
Assuming X £ terminated by a transition to (1,1), (6. A. 2) 
shows that states {1,1} or {1,2} are equally likely for the 

commencement of interval X . This is also the case for 

n 

X ^_2 terminating by entry into states (1,2) or (2,1). Thus 

information regarding the state of the system derived from 

the interval - n _ 2 provides no information regarding the 

state of the system at the outset of X , hence X and X 0 
J n’ n n-2 
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are independent. Similarly, all knowledge of the system 
derived from knowledge of the events ^ n _ 2 > ^n-3’**’’ s ^eds 
no light on the distribution of X . 

This completes the proof of Theorem VI. A. 2. 

To show that a first lag dependence exists, it is 
sufficient to establish that cov(X q ,X^) / 0. To use Theorem 
V.B.l which formulates the serial covariance of a semi- 
Markov generated point process, it is necessary to determine 
the matrix of ’weighted first moments, M^. Let U be a random 
variable with density Y t (k,A). Then E[U] = k/A and 
E[U 2 ] = k(k+l)/A 2 . 

Thus, using (6. A. *1.2) and (6. A. 4. 3) 

1/2 3A\ 

h - 

\l/i» 1/2/ 

Conventionally, T° = I, and in this process 

00 

T = T, 



so 



cov(X ,X, ) = tt t M_ ( I-T°°)M n 1 
o 1 — 1 1- 

= -1/16 A 2 
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The first serial correlation of this process is 



given by 



P;L = cov(X o ,X 1 )/Var(X 0 ) . 



Lemma V.B.2 gives the variance of the process 
The matrix of second moments is (from (6. A. 4. 2) and 
(6. A. 4.3)) 



M = 

2 



3/4 A 2 


3/2 A 


1/4 A 2 


3/4 A 



so 



Var (X ) = tt t (M 0 -M 1 T c °I>L )1 
o — 2 1 1 - 

= 5/8 A 2 , 



and 



P;L = - 1/10 , 

v.’hich is the result of Lawrence (1973) as well as Lewis, et 
al (1973)- Note that while Lawrence gave the result that 
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p = -1/10 for this process, we have established the stronger 
result of Theorem VI. A. 1. 

Theorem V.B.2 gives the spectral representation of 
the process. Computing first 

lx- 1/2 l/2\ 

(Ix-T)- 1 = \U1 5=1 ZiJ 

x(x-l) 

then, taking i = 

( ^ ) / \ f ^ /; i / T r 3. ^ i T \ — 1 CO / / iW - \ 1 CO , T\ 1 CO / / — iW ^ \ 

fj (to) = {26+(15e +l)e /(e -l)+(.15e +l)e /(e -1) 

= (5-cos co)/5 

v;hich is the form presented by Lewis, et al (1973)* There 
it was derived by the method outlined in Chapter III, 

Section A (above). 

VI. A. 5. Determination of T, and M„ for the Collapsed 

5 

E(k,p) Semi-Markov Process 
The ground work for determining the transition 
matrix, T, of the collapsed state space, S c , was established 
in Subsections VI. A. 2 and VI. A. 3* Equations (6. A. 2. 3), 

(6. A. 2.^0 and (6.A.2.5) Gave the one stage transition in 
the reduced state space, S , to be a modified multinomial 
random variable for states satisfying the relation (6. A. 2. 2). 
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The lumpability condition of Subsection VI. A. 3 

states that the sum ofthedirect transition probabilities in 

S from an element of a state set { (j ,j )) e -S to 
r jl p c 

each of the elements in { (j -!,... ,j ') } gives the collapsed 

■t P 

space direct transition probability. In general, then, the 
method for determining Pr[{ (j , . . . ,j ) } : {j ' , . . . ,j ' ) }] 

_L 

is to enumerate the elements of { (j ■!,... ,j ') } = {v, , . . . ,v }, 

_L p _L S 

select a particular element u e { (j ,j ) } and evaluate 
(6. A. 2. 5) for all pairs (u : vp , summing the results. 

The process outlined is cumbersome, although easier 
to implement than many of the computations associated with 
superposition processes. While there may be as many as p 
elements in a collapsed state set, this will only occur when 
the indices contained in a typical element of the set are 
all distinct. Generally, several component processes will 
be in the same stage, resulting in a multiplicity of indices 
in the collapsed state set. 

Example VI. A. 2: Ttio.nt>-Lt-Lon -in the 

El 5, 2) ?fioeei>6. In the collapsed state space of the E(5,2) 
process, what is Pr[ {1 ,1 ,2 , 2, 2} : {1 ,1 ,1 ,2 , 3) ]? Although 
there are 20 elements of {1,1, 1,2, 3}, only six satisfy the 
condition (6. A. 2. 2) with respect to the generic element 
(1,1, 2, 2, 2). The condition is violated in all cases in 
which more than one component process must enter stage 1. 

For example 
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Pr[(l,l,2,2,2):(l,2,3,l,l)] = 0 . 



Further, each of the six attainable states will be chosen 
with equal probability, since for example 

Pr [( 1 , 1 , 2, 2, 2) : (1,1, 1,2, 3)] = Pr[ (1,1,2 ,2 ,2 ) : (1,1, 3,2 ,1) ] 

Thus, using (6. A. 2. 3), (6.A.2.JJ) and (6. A. 2. 5), 

Pr[{l,l,2,2,2}:{l,l,l,2,3}] = 6( 2)(5" 3 ) = 12/125 

Continuing the general development, we examine the 

moments of the process. Determination of the M matrices 

s 

is a byproduct of the T computation. In Chapter V, the 
( s ) 

matrix E = {y.. } was defined as the matrix of s-th 
s ij 

moments of the random variables, S.., of a semi-Markov 

’ U ’ 

process. In a semi -Markov process corresponding to an 

E(k,p) process, the distribution of S.. is totally determined 

a j 

by the rate A, and the number of state transitions, r, from 
state i to state j given by (6. A. 2. 3), where i and j are 
indices assigned two of the state sets of S . 

It is convenient at this juncture to establish 

Lemma VI. A. 1: Let X be a non-negative random 

variable with probability density function Y fc (r,A). Then 
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E[X k+1 ] = A~ k-1 (r+k) !/(r-l) ! 



= A 1 (r+k)E[X k ] , k = 0,1,2,... (6. A. 5.1) 



Proof: Formally operating on the definition of expectation 

of an Erlang distributed random variable 

E[X k+1 ] = / (x k_1 ) A r ^ e~ Ax dx 

(r+k ) ! ,-k-l “ A r+k_1 x r+k e' Ax dx 

(r-1) ! A J (r+k) ! 



_ (r+k)! ,-k-l 

TFTTT A 



= A -1 (r+k)E[X k ] . 



Taking E[X°] = 1, so that E[X] = r/A, completes the proof. 

Returning to the computation of M , assign an index 

o 

j = 1,...,VJ to each state set of S^. Denote by r.y the 
number of stages separating the states of i and j , where 



r^ is given by (6.A.2.3). Then 



E 



s+1 



{(r iJ +s)!/(r ij -l)!}/A s+1 

l(r u +s)g ij ))/x • 



(6. A. 5- 2) 
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and 




(6. A. 5. 3) 



In particular 




(6. A. 5.-4) 



and 




(6. A. 5.5) 



The results of the computation proposed in this section and 
applied to selected E(k,p) processes are summarised in 
Appendix C. 



survivor function R.(x) = exp(-X.x). Then Y has the 

J J k 

hyperexponential survivor distribution R(y) = £ q.exp(-X.x). 

j=l 3 3 

Let IJ^(t) represent a counting process in v:hich the 
times between events are iid random variables governed by 
R(y). Then U^(t) is said to be in stage j if the time to 
the next event in the process has the survivor distribution 




Following the procedure of Section A, let Y 



X. with 
1 



probability , j = 1 



k, where X. is governed by the 
1 



Rj(y). 
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Let N(t) = N^(t) + ...+ Np(t). The state of the process 

N(t) is the vector v ) where v . taking on values 

-L P J 

l,...,k corresponds to the stage of component process j. 

An event occurs in the process N(t) whenever an event occurs 
in a component process. The state of N(t) will change only 
in that element corresponding to the component process 
responsible for the event, and then only if the component 
process enters a new stage. 

The time between events in the superposed process N(t) 
will be the minimum of S^(v^), i = l,...,p, where S^(v^) 
is the time to the next event in process i given that it is 
currently in stage v^. Because of the lack of memory 
property of the exponential distribution, there is no need 
for concern with regard to forward recurrence time in this 
formulation . 

The probability that component process m is responsible 
for the next event in N(t) is 

Pr[S (v ) = min. {S . ( v . ) } ] 
m m ill 

P 

= ),(v )/ Z A(v.) , (6.B.1) 

m i=l 1 

which is independent of all history except the current 
state of the system. Here X ( u j ) is the parameter of the 
exponential distribution governing a process j in stage v.. 

J 



1?4 



Thus, a semi-Markov process has been constructed which 

represents the superposition of p iid hyperexponential 

renewal processes. Transition from state v = (u n ,...,v ) 

t P 

to v' = is possible only if v and v* differ in 

at most one element. Let m be the index corresponding to 

the element of v' which differs from v.. Then, if v = j 
— 1 m 

and = j ' , 

A .q . , 

Pr [ u : v ' ] = ■ ■ ^ J , j ¥ j ' ( 6 . B . 2 ) 

l A ( v . ) 
i=l 1 

That is, the probability of transition from v to v' is the 
probability that the next event is from process m, and that 
process m enters stage j' following the event. 

The probability that the system returns to its original 
state is given by 

P 

E A(v i )q(v i ) 

Pr[ v : v ] = - - ~ p (6.B.3) 

l A ( v . ) 

1=1 1 

Example VI.B.l: The H(2, Psio cc.6 A . VJith k = 2 and 

p = 3j the survivor function is 

~A,t -, ^1^ 

R(t) = q x e + q 2 e , 

and the state space is 
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S = {(l,ljl), (1,1,2), (1,2,1), (2, 1,1), (1,2, 2), (2, 1,2), 

( 2 , 2 , 1 ) ,( 2 , 2 , 2 )} 

Figure VI.B.l shows the network of possible transitions. 

Note that all arrows are double ended , and that each 
transition represents an event in the main process . 

The sojourn times in each state are the minimums of 
exponential random variables, hence are themselves exponen- 
tial. The mean time in state (i,j,£) is (X. + X. + X,) - '*' 

<J •£. 

for i,j,£ = 1,2, where it is understood that the sojourn 
time is considered to be the time between events regardless 
of the state entered following an event. Transition 
probabilities, shown in Fig. VI. B. 2 are computed from 
(6.B.3) . 

VI.B.l. The Collapsed State Space, S c 

Examination of Figures VI.B.l and VI. B. 2 suggest 
a collapsed state space might be appropriate to this 
problem. Let u = { (u^ , . . . ,u^) ) be an element in the 
collapsed state space, S c » Here a will represent all 
vectors v e S for which u. elements of v have the value j, 

J 

j = l,...,k. In Example VI.B.l, the following correspondence 
applies : 

u = { 3, 0 }< >v = (1,1,1) 
u = { 1 , 2 }< >v = (1,2, 2), (2, 1,2), (2, 2,1) 
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Figure VI.B.l Transition network for the stage transitions 
in an H(2,3;£L>^) process. 

In this system, all stage transitions are recorded as events 
in the point process. In addition, it is possible to have 
direct transitions from a state to itself, resulting in a 
point process event. 
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arcs in Fig. VI. 3.1. plus direct return. 



u= { 2 , 1 =* v = (1,1, 2), (1,2,1), (2, 1,1) 

u = (.0, 3><-^v = (2,2,2) 

Formally , 

S = { (u. , . . . ,u, ) |u.e{0, . . . ,p} ,Eu.=p) . (6.B.1.1) 

c 1 K J J 

The cardinality of S c is the same as the number of distinct 
sets of k objects taken in groups of size p, i.e., the 
figurate number 




This compares favorably with the cardinality of S, |S[ = k^. 
For example, if k = 5, and P = 3 then |S| = 125 while 

hoi " 35. 

Two vectors u,u' in 5 are said to be adjacent if 
k k c 

2 I u . — u ! | < 2 and l (u.-u!) = 0. Adjacent states in S 

j=i j j 1 - j=i j j c 

have corresponding states in S which differ in at most one 
element, hence direct transitions in 5 are possible only 
between adjacent states. 

To establish that the Markov property may be ascribed 
to S c , recall from Section VI. A. 3 that it is sufficient 

that S partitions S in such a way that for each v in 

0 

S represented by u in S^ } 
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Pr[u:u'] = E Pr[v:v'] = constant 
•v'ev 1 

For definiteness, assume that a transition from u to u' 
results from a component process in stage i transiting to 
stage j. In u, there are u^ processes in stage i, and the 
probability that one of these processes generates the next 
event is 



k 

“iV P 

n=l 



u ^ 
n n 



which corresponds to summing the expression (6.B.1.1) for 
the probability that a particular process is responsible for 
the next event over all processes in stage i. The probability 
that the chosen process will enter stage j is q., leading 

J 

to 



k 

Pr[u:u'] = u.X.q./ E u X (6.B.1.2) 

i i J n=1 n n 



irrrespect ive of the state of S chosen to represent u. 

Continuing the Example VI.B.l, the transition 
matrix of the collapsed H(2,3;q_,X^) process is shown in 
Fig. VI. B. 3- 

VI. E. 2. Expectation Matrices for the H (k,p,q,X) 
Semi-Karkov I recess 

As observed above, the sojourn time in a state 

k 

u c S is exponential with parameter 0 = T. u . A independent 

c U ^ 1 1 
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30 



21 



12 



03 



30 



21 



12 



03 



^1 

X 2 +2X 1 



2X iQ i"t- X 2 Q 2 
X 2 +2X 1 



2X 2 q l 

V 2 2 



2X l q ? 

X 2 +2A 1 



2X iQ i"^ X 2 Q 2 
X 2 +2X 1 



*1 



X l q 2 



X 1 +2X 2 



Figure VI. B. 3 Transition Matrix for the H(2,3;Q,A_) 
collapsed state space, S c - 

The states in this process are denoted {ij} to indi 
their role as partitioning sets of the state space, 
example , {21} = {(112 ) , ( 121 ) , ( 211 ) } ; {12} = {(122), 



process ; 



cate 
S . For 
(212), (221)}. 
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of the subsequent state. By Lemma VI. A. 1 , if X has proba- 
bility density function f(t) = Xe~^ t = y t (l,A), then 

E[X r ] = r !/A r , k = 0,1,2,... ( 6 .B.I. 3 ) 



Indexing the sets of S c on the positive integers 

so that 0 ^ is the parameter of the exponential sojourn time 

distribution in state u^, let E r be the matrix of expectations 
(r) 

y. . of sojourn time in state i conditioned upon a direct 
ij 

transition to state j . Then 



yf 3 ^ = rl/ef, if i adjacent j, 



and is not defined but may be taken to be 0 otherwise. 
The matrix M of weighted moments is 



H r - *ij> 



where the transition matrix of the collapsed process is 



This method is used in Section VIII. B.l to generate 
numerical spectral representations for the E(2,2;q,A_) 
process . 
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VII. THE DENSITY OP AN ARBITRARY INTERVAL IN 
THE SUPERPOSITION OF RENEWAL PROCESSES 



The probability density function of an arbitrary interval 
in a superposition point process can provide some initial 
information regarding the component processes. This chapter 
examines the pdf of an arbitrary superposition interval as 
a function of the component interval probability density 
function. Although the material presented is not new, it 
is given here to provide an added characterization of the 
Erlang and hyperexponential processes. 

In Section A, a general component process interval pdf 
is assumed, and the form of the marginal superposition 
density is determined. It is shown that the initial value 
of the density is a function of the number of component 
processes . 

Sections B and C apply the results of Section A to the 
E(k,p) and H(k,p;q,X_) processes, respectively. 

VII. A. THE ARBITRARY INTERVAL DENSITY IN THE SUPERPOSITION 
OF RENEWAL PROCESSES 

The purpose of this section is to derive heuristically 
the probability density function of an arbitrary interval 
in the superposition of p iid renewal processes. This 
result was originally given by Cox and Smith ( 195 * 0 . Let 
R(t) = Pr{X>t) be the survivor function of the intervals of 
of the component renewal processes, with associated pdf f(t). 
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Then the equilibrium excess distribution (forward recur- 
rence time distribution) is (Cox and Lewis, 1966) 

Z(t) = lim Pr{time to next event>t | event at u} 

U-V-oo 

00 

= (E[X]) _1 / R(v)dv . 

t 

The length of an arbitrary interval in the super- 
position process is the minimum of the time to the next 
event in each of the p component processes. That is, if 
X (p) denotes an arbitrary interval of the superposition 
process , 



R^ P \t) = Pr[X^>t] = H Pr [X., >t ] , 

j = l J 

where X. is the time to the next event in the j-th component 
J 

process . 

Let s be the index of the component responsible for the 
most recent event. Then 



Pr [X . >t ] 




5 



J 



so 3 



R^(t) = R(t)Z P 1 (t) 



(7.A.1) 



18'1 



The intervals of the component processes have pdf 



f(t) 



dR 

dt 



(t) 



* 



so the pdf of an arbitrary superposition interval is 



f (p> (t> 



dR 

dt 



(P) 



(t ) 



(f(t)z(t) + (p-i) g^TT }Z? 2(t) 



(7. A. 2) 



The initial point of the arbitrary interval density is 
closely related to the number of component processes, as can 
be seen from the following 

•Theorem VII. A. 1: Let f(t) and f^ p ^(t) be as defined in 

this section. Then 



f (p) (0+) = f(0+) + (p-l)/E[X] , (7. A. 3) 

and in particular, when f(0+) = 0 and E[X^ P ^] = 1, then 

f (p) (0+) = (p-l)/p . ( 7 . A . 4) 



Proof : From the definition of Z(t) as the survivor function 

of a non-negative random variable it is clear that Z ( 0 ) = 1. 
Since R(t) is also the survivor function of a non-negative 
random variable, R(0) = 1. Thus, in (7. A. 2), 
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lim f (p) (t) = f(0+) + (p-l)/E[X] . 
t->-0 

For a stationary process, E[X^ P ^] = E[X]/p, so if 
E[X^] = 1, then E[X] = p. Hence for f(0+) = 0, and 
E[X (P) ] = 1, 

f (p) (0+) = (p-l)/p . 

This completes the proof of Theorem VII.A.l. 

The final form of this result is related to a similar 
result of Cox and Lewis (1966, Ch. 8). Recalling from 
(2.B.2.5) that 

m£ p ^(t) = m f (t) + (p-l)m , 

and observing that as t grows large the dependence on the 
arbitrary event diminishes and m^Ct) tends toward m, so that 

m£ P ^ («) = pm . 

Thus if the component processes have m^(0+) = 0, then 



m£ P ^ (0+)/m£ p ^ (°°) = (p-l)/p . 



(7. A. 5) 



186 



VII. B. THE ARBITRARY INTERVAL pdf FOR THE E(k,p) PROCESS 
In the E(k,p) process, the component interval pdf Is 



I 1 



Y t (k,X) = A k t k_1 e" Xt /(k-l)! 



(7.B.1) 



The survivor function is 



oo 



R k (t) = f Y u (k,X) du 




(7.B.2) 



and the equilibrium excess distribution is 



OO 



Z k (t) = (A/k) / R k (u) du 

-1 k 

= (Ak) x I (k+l-j ) Y t (j,A) . (7.B 

j=l 

Substituting (7.B.1), (7.B.2) and (7.B.3) in (7. A. 2) 
yields 



4 P) (t) = {Y t (k,x) 



k 

I (k+l-j) y, ( j } A) 

j = l 



+ (p-l)/(kA)[ Z Y.(J,A)r} 

j = l ° 



k 



P-2 



x { Z (k+l-j) y,(j,A)} 

j=l t 



(7.B.H) 
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Computation of the pdf may be simplified by implementing 
the identity 



Y t (j,nX) Y t (k,mX) 



XnV 



(n+m) J 



J j-l 2 ) Y t (j+k_1 ’ mX+nX) • (7.B.5) 



Thus the product of Erlang probability density functions is 
a scaled Erlang pdf, so f^ p ^(t) is a linear convex 
combination of Erlang probability density functions. 

Using (7.B.5), (7.B.4) can be expressed as 



f£ p) (t) 



= (Xk) 1_P { Z (k+l-j) Y^ ( J , X ) > P_2 
0 = 1 t 

x 2 X { Z^ 2" (k+j) (k+l-j) ( k ^” 2 ) Y t (j+k-l,2X; 



+ (p-1) Z ( 2j ’~ 2 ) Y.(2j-l,2X) 

j = l V 0-1 ' Z 



2 (p-1 ) V Z 2 (J+n) ( j i k 1 2 )Y t (J+n-l,2X)} , 
j=l n=j+l \ J-l / t 



(7.B.6) 



N 

= Z a y t (j,P^) , (7.B.7) 

j = l J r 



N 

where N = p(k-l)+l , Z a. = 1 and a.>0, j=l,...,N. 

j=l J 
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Applying Theorem VII. A. 1, and observing from (7.B.1) 
that for k>l, YQ + (k,A) = 0, and with E[X] = k/A , then 

f£ p) (0+) = A (p-1 ) /k 

= (p-l)/p , for A = k/p . (7.B.8) 



Applying the formula (7.B.6) to the E(2,2) process 
yields 



f^ 2) (t) = { ( 1/ 2 ) Y t ( 2 ,2 A) + (l/4)Y t (3,2A) 

+ (l/2)Y t (l,2A) + ( 1/-4 )Y t ( 3 >2A ) 
+ (l/2)Y t (2,2A)}/2 



= (l/*»){Y t (l,2A) + 2Y t (2,2) + Y t (3,2A)} 



which is identical with the probability density function 
derived for this process using the semi-Markov generated 
point process representation (6. A. *1.5). 

Using (7.B.7) and Lemma VI. A. 1, the r-th moment of an 
arbitrary interval of an E(k,p) process is 



E[(X (p ) ) r 



] = 



N 

I 

J = 1 



(r+j-1) ! 
("j - l)~! 



a . (pA) 
J 



-r 



(7.B.9) 
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Thus 




and 




(7.B.10) 



Recall fron Chapter III, Section A that in direct 
computation of the spectrum of intervals of an E(k,p) 
process, no provision was made for evaluation of the scale 
constant Q^(k,p) (3. A. 1.22). Cox and Lewis (1966, pp . 78) 
relate the initial points of the count and interval spectra 
of a stationary point process, given in equation (2, A. 3-2) 
and expressed here in the notation of superposition processes. 



arbitrary interval of the superposition. Equation (3.C.8) 
gives the initial value of the E(k,p) count spectrum to be 



Now (7.B.10), (7.B.11) and (7.B.12) can be used to determine 
the initial point of the interval spectrum, and thus provide 
the information necessary to evaluate Q^(k,p) in terms of 
the polynomial ratio representation presented in Chapter III. 



gj p ^ (0+)E[X^ ] = fj P ^ (0+)C 2 (X^ 



(7.B.11) 



where C(X^ P ^) is the coefficient of variation of an 



g| P ^(0+) = pX/(k 2 Tr) 



(7.B.12) 
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In Chapter VII, the computational details are described, 

and pdf's for several values of k and p are displayed which 

illustrate the results of Theorem VII. A. 1, along with other 
\ 

more qualitative features. 

VII. C. THE ARBITRARY INTERVAL DENSITY OF THE 
H(k,p;c,A) PROCESS 

The component interval density in the H(k,p;q.A_) process 
is given by 

k 

f(t) = Z q . A . exp{-A . t } , (7.C.1) 

0=1 J J J 

with corresponding survivor and equilibrium excess 
distributions 



k 

R(t) = Z q. exp{-A.t} 
j = l J J 



and 



k 

Z(t) = (1/E[X]) Z o. exp{-A t}/A. , 

0’ = 1 J J J 



(7.C.2) 



(7.C.3) 



where 



k 

E[X] = Z q • / X . . 
j=l J 0 



(7.Cd) 



Using (7.C.1) through (7.Cd) in ( 7 - A . 2 ) gives the 
density of the arbitrary superposition interval for this 
process : 
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/ _ \ k k f ^ - 1 \ — A. + A )fc 

f (p) (t) = Z Z qjq n (/+ P - l) e J 

J=1 n=l \ n / 



k q, -A.t\p-2 //■ k q . \ p-1 



x U4 e J 




. E , X. 
J=1 J 



(7.C.5) 



Inspection of (7.C.5) reveals that f^ P ^(t) is also hyper- 
exponential and can be put in the form of 



f^(t) = Z B.y, exp{-y.t} , 
j=l J J J 



where 



J 
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VIII. NUMERICAL RESULTS 



Throughout the course of this research, considerable 
effort was expended in performing the computational proce- 
dures outlined in the various sections of this thesis. The 
reasons for this effort were 

1. To verify the methodology by comparing results of 
varying approaches to the same problem; 

2. To establish the various procedures as practical 
methods of obtaining answers to particular questions; 

3. To provide a basis for comparison between the various 
methods , and 

. To provide qualitative means of distinguishing the 
processes studied, and in particular tabulate the 
forms of the spectra and serial correlations for small 
p and k . 

Chapter III was devoted primarily to deriving an analytic 
representation for the spectrum of an E(k,p) process. 

Section A of this chapter describes two methods of evaluating 
that representation. Included in the section is a brief 
description of the FORMAC algebraic manipulation preprocessor 
which has proved useful in several situations. 

Chapter V developed a method for computing the spectrum 
of a semi-Markov generated point process which involves 
determining the inverse of a matrix (Ie^ w -T), where w is 
the spectral argument. In Section B three methods of solving 
this problem are presented, each of which has been used 
successfully in analyzing the interval spectrum of various 
E(k,p) processes which have been given semi-Markov generated 
point process representations. 
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A computational form for the probability density function 
of an arbitrary interval of an E(k,p) process was derived in 
Chapter VII. Section C describes implementation of the 
method, including comparisons of certain specific values with 
those same values determined through spectral analysis. 

Section D contains a brief discussion of the interval 
bispectra of E(k,p) processes modeled as semi-Markov 
generated point processes. 

Use of the Fast Fourier transform to determine the 
sequence of serial correlations of a point process from the 
spectral density is discussed in Section E. 

In Section F the computation of the second order count 
spectrum of an E(k,p) process is presented. 

Throughout the chapter we give numerous graphs and tables 
which illustrate the properties of the functions being 
studied and provide a basis for comparison between processes. 

Computer programs used in this analysis are listed in 
Appendix E. 

VIII. A. DIRECT COMPUTATION OF THE SECOND ORDER E(k,p) SPECTRU 

Lewis, et al ( 1 9 7 3 > Sect. 5), and Chapter III of this 
thesis discuss in detail the representation of the interval 
spectrum of an E(k,p) process as proportional to the sum of 
the ratios of trigonometric functions (3-A.22), wherein 
Q^(k,p) is defined as the constant of proportionality. 

Two methods of evaluating (3. A. 1.22) have been developed. 
The first, developed by \7. J. Hayne , (See Lewis, et al, 1973) 



evaluates the summation numerically for a finite set of 
values of a >. The second, developed to supplement this 
research, makes use of the symbolic manipulation capabilities 
of FORMAC (Raney, 1973) to determine an exact formulation 
as the ratio of finite polynomials in cos w, as expected 
from Theorem III. A. 2. 

VIII. A. 1 Numerical Approximation of the E(k,p) 

Interval Spectrum. 

The computational form of the second order spectrum 
of the E(k,p) process is (3. A. 1.22) 



f< p) (uO 



^ (l-COS w) P r 

Q x (k,p) pm £ 

A Ak^ P J x =l 



k 

E 



2a. 



J p 1 ( a j +b j)cj 



(8. A. 1.1) 



with J, aj, bj and Cj as defined in (3. A. 1.23). A direct 
numerical evaluation of (8. A. 1.1) was implemented in a 
FORTRAN program, SPECD. The program was used by Lewis , et 
al. (1973) in the preliminary research of the Erlang 
superposition process. 

The following procedure was followed by SPECD: 
a. Enumerate the distinct sets 



7 J ^ 1 , . . . , k , 1 1 , . . • , p 

by setting j^=l, i=l,...,p, and incrementing the indices so 
as to maintain the inequality j ^ <_ j ^ , for j < k. 
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b. For each value of w chosen uniformly between 0 and tt, 
and each set J, evaluate 



2|J|a. 



( a j+bj)Cj 



where |j| represents the number of distinct permutations of 
the elements of J. 
c. For each w, set 



U ( w) = 



_ (1 - cos ti) P 



•2 1.7 1 a 



7 



Ak 



2p 



J (aj+bj)cj 



(8. A. 1.2) 



d. Use quadratic extrapolation to evaluate U(o) and U(tt) 

e. Since the integral of f| p ^(u) must equal 1, and 
fj P ^(w) = Q^(k,p)U(w), approximate Q^(k,p) by 



N 

Q>(k,p) = {(tt/K) Z U ( w . ) } 
A j=0 J 



-1 



(8. A. 1.3) 



where w. = ttJ/N. 

J 

f. Set fj p) (w.) = 0 (k,p)U(w.) 



(8 .A.l.if) 



Some additional information available from this program 
is the variance and coefficient of variation of an arbitrary 
interval. Using the relation 



gj P ^ (0+) = pA/(k 2 Ti) 



(8. A. 1.5) 
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and 



gj p) ( 0 +)E[X (p) ] = fj p) (0+)C 2 [X (p) ] , ( 8 . A. 1.6) 

previously given as ( 3 .E. 6 ) and (7.B.11), where X^ p ^ 
represents the Interval following an arbitrary event in the 
superposition process, yields 

C 2 [X (p ) ] = (fj p) (0+)kn ) _1 , ( 8 . A. 1.7) 

and 

V[X (p) ] = (k/(p 2 X 2 TTf| p) (0+))} . ( 8 . A. 1.8) 

Figures VIII. A . 1 through VIII. A. 10 are comparative 
spectral density representations of the various E(k,p) 
spectra generated by the foregoing method. 

VI I I . A . 2 Analytic Determination of the E(k,p) Interval 
Spectrum 

This phase of the research made use of an algebraic 
manipulation routine, FOF.MAC, to compute a condensed formula 
of the second order interval spectrum for specific values of 
k and p. Theorem III. A. 2, guaranteeing that the interval 
spectrum of an E(k,p) process was that of a mixed auto- 
regressive/moving average process, required examination with 
regard to confirming the estimates of the order of the process 
as proposed in Section III.D. 
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Figure VIII. A. 1 Interval spectra, f|^(w), for E(2,p) 
superposition processes, p=2,...,8. The squares at 

= ijr represent the flat spectrum of a renewal process. 

Note that for k=2, the spectrum is fairly flat with a notch 
developing near the origin with increasing p, as the initial 
point of the spectrum approaches its asymptotic value, 1/kTr . 
There is a relative peak at w=ti (period T=2) representing 
the quasi-alternation between events from the two processes 
for p=2. 



i 
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Figure VIII. A. 2 Interval 
position process, p=2,... 
the flat spectrum of a renewal 
in p=2,3 and ^ spectra centered 
tt/2 ( T= 4 ) respectively. 



spectra for the 
,8. The squares 
process . 
at if(T=2) 



E(3,p) super- 
of 1 / tt represent 
Note the humps 
, 2 tt/ 3(T=3) and 
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Figure VIiI.A.3 Interval spectra for E(*J,p) superposition 
processes, p=2,...,6. The crosses at 

f + (w) = - represent the flat spectrum of a renewal process. 

As in previous cases, relative peaks at periods p appear in 
the spectrum diminishing in amplitude as p increases' and the 
spectrum approaches the flat spectrum of the Poisson process. 
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Figure VIII. A . U Interval spectra for E(5,p) superposition 
processes, p=2,3>^. The crosses at 

= — represent the flat spectrum of the renewal 

process. In addition to the relative peaks exhibited in 
previous plots, a secondary peak can be seen at T=p/2 for 

the £(5,*!) process. As in previous figures, f| P ^(0+) 

decreases monotonically toward l/kir as p increases. 
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Figure VIII. A. 6 Interval spectra for the E(k,2) 
processes, k=2,...,8. The crosses at 

f(p) 



(to) = 1 /tt are as in previous figures 



Note 



the sharp peak at co=tt representing a period of 2 
and increasing as k increases. This is because 
the intervals in the component processes become 
less dispersed as k increases (coefficient of 
variation decreases. Fig. VIII. C.l), and the 
alternation of component events in the 
superposition becomes more pronounced. 



fj P) (to) 



x x x x x 





K X X X X X X X X X 



TT/h Tt/3 



t 



m/2 
— h 



1 1 



2ti/3 3tt/U 
— -i 1 



(0 
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peaks at u=2tt/3 corresponding to a period T=3, clearly are 
increasing v/ith k. 



20*1 



>-3 e 



«H| t= 




Figure VIII. A. 8 Interval spectra for the E(k,^) processes, 
k=2,...,6. The crosses at 1 /tt as before'. With p even, 
v;e see the indication of an harmonic peak at period 
T=p/2=2, becoming more pronounced as k increases. 
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Figure VIII. A. 9 Interval spectra of the E(k,5) processes, 
k=2,3, I J. The crosses as before. Here we see a main peak 
at T=5, u=2tt/5, in the E(^,5) process, a secondary peak is 
apparent at T-5/2, = ^ir/5. ' These peaks would be expected 

to becorr.e more pronounced as k increases . 



206 




Figure VIII. A. 10 Interval spectra for the E(k,6) processes, 
k=2,3, ij . The crosses at 1/u as before. Here the main peak 
is at w=ir/3 (T=6=p) with a secondary peak at 2ir/3(T=p/2) for 
the E(^,6) process. 
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While such computation is not difficult to do by hand 
for k=2, and p=2, 3 or 4 (Fig. VIII. A. 11) the magnitude of 
the coefficients (in integer form) and the number of terms 
involved for larger values of k and p renders hand calcula- 
tion virtually impossible. However, integer calculations 
were required so that differentiation between zeroes and 
very small numbers would be possible. 

Subdivision VIII. A. 2. a contains a description of the 
problem in such a way that an algebraic solution is feasible. 

In Subdivision VIII. A. 2. b wer give a brief description of 
FORMAC outlining those features which make it suitable for 
this problem, along with the drawbacks which limit is 
usefulness . 

VIII. A. 2. a Problem formulation 

To solve algebraically for the interval spectrum of an 
E(k,p) process, begin with the formulation of Chapter III, 
Section A, given by equation (3.A.2.4) 



fj p) (w) = Q x (k,p) 



(1-COS ld) P 



Xk 



2p 




2a, 



< a ? +b L )c L 






where, it will be remembered, R, is an index designation 
vector with elements, L , which are distinct permutations 
of the same set of integers. (The sets i/(^/2)( p), as d e rj_ ne d 
in Section III.D, are used in place of the index designation 
vector, R , w hen k is even. The conversion is tedious but 
straightforward, and discussion will be omitted.) 
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The general procedure to be follov;ed is to enumerate 
the index designation vectors, {R^}, and form the sum 



2a, 



S t (a>) 



Z 

LcR, 



(a^+bf)c L 



(8. A. 2. 2) 



for each R, . Each sum, S^(co), is then placed over a common 
denominator, so 



S t (u) = N t (u)/D t (u). 



The terms (w)/D t (to) are combined to form 



S (to) = 



_ (1-cos u) P - / P \ N t (w) 



Ak 



2p 



(it) 5 s 



t v D t (to) 



(8. A. 2. 3) 



which again is placed over a common denominator. 

Finally, using the known value of f| p ^(0+) , (Equation 
(7.B.11)) Q^(k,p) is determined from the equation 



f{ p) (0+) = Q x (k,p) S(0+) 



(8. A. 2.4) 



The actual procedure is most easily explained 
through an example: 

Example VIII. A. 1: The interval spectrum of 

the E(Z,Z) process. The class of all index designator sets, 
R. , can be operationally defined by 
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• • • 



{R t > = {(n 1 



,n k ) |p>n J > : n j . + 1 >0,j = l, 



k 

,k-l; E n,=p) 

(8. A. 2. 5) 



For the E(3,3) process 



{R t > = {( 3 5 0 j 0 )j( 2 , 1,0), (1,1,1) } 

— { 5 ^2 5 



Recalling the definition of S^. ( to ) (8. A. 2. 2), and the 
results of Lemma III.A.l, as expressed in (3. A. 2. 5), 
(3. A. 2. 7), (3. A. 2. 8) and (3. A. 2. 9), 



3 

S, (u) = (1/3) E {i-cos(-' IT 4 + - ^ )}3 

j = l 5 

(1/3) E [ n {i-cos(^4^)}]3 
= .1 = 1 ir./,i J 

(2 _ ^(l-cos w)} p 



(8. A. 2. 6) 



At this point a FORMAC program must be written which 
is tailored to the specific problem. Using the identities 
expressed in (3. A. 2. 12) and evaluating the sine and cosine 
terms, the numerator of S^(u>) becomes 



N-lCco) = [ 2+cos (to/3) - 3sin(w/3) ][ 1-cos (to/3) ] ( 1 / 2 ) 

+ [2+cos(w/3) + 3sin(o)/3) ][ 1-cos ( w/3 ) ](l/ 2 ) 

+ [2 + cos(to/3) - 3s in ( w/3 ) ] [ 2+cos ( oj/ 3 ) + 3sin(ot/3)] 

(8. A. 2. 7) 
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which is easily evaluated by FORMAC . Substituting the 
appropriate identities from Appendix B results in 



o \ _ 3(139 + 100 cos to + ^ cos u) 

S n {bi) - 5 



(8. A. 2. 8) 



(1 - COS 03) 



Similarly , 

3 (>2cos^-co8^)(l-oos^)- 2 (l-co s 2l|ti:y 

S 2 ( “ ) " jEl ( 7 - 6 co S g 4 ^ - 3 ccs 2 %H 7 2 e 03 gl (^+“ -) 

3 3 3 (8. A. 2. 9) 

is evaluated in a specially constructed FORMAC program, using 
appropriate trigonometric identities, and becomes 



c _ ^(1^27^ + 2^39 cos 03 - 9l8cos 2 03 + 8lcos 3 w) 

o p \, CO y p p 

(l-COS 03)^(27003^03+169 ) 



(8. A. 2 .10) 



The index designator set R-. represents a single element 
which , when evaluated as above gives 



S 3 (03) 



8 

3(l-cos 03 ) 



(8. A. 2. 11) 



Substituting (8. A. 2. 8), (8.A.2.9)and(8.A.2.11) in 
(8. A. 2. 3) yields the final form of S(o3): 



S ( 03 ) = (1-COS 03) 3 {S 1 (03) + 3S 2 (03) + 6S 3 (03) }/A3 6 



_ (2')9873+1 ) >2020cos q>-2?389cos ? o+17 j )96cos 3 oR-C^8cos\)) 
(l60+-27cos 2 o0X 



(8. A. 2. 12) 
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Using the results of Chapter VII (7.B.10) and 



(7.B.12) 




C 2 [X 



as implemented in Section B of this chapter yields 

(0+) = X/(3tt) 5 

(3) n _ 3983 

J £5^1 ’ 



and 



E[X (3) ] = 1/X . 



(8. A. 2. 13) 



Using (8. A. 1.6) and ( 8 . A. 2.13) gives the result 



fj 3 ) (C+) = ( X/3tt ) ( 1/X) /( 39 83 / 6561 ) 
6561 

( 3983) ( 3 ) 



(8. A. 2. 14) 



Evaluating (8. A. 2. 12) at w=0 and using it along with 
(8. A. 2. 1*0, gives the scale factor Q^(3 5 3): 



Q x (3,3) 



31 

3983tt 



(8 .A. 2. 15) 



Thus the final expression for the E ( 3 » 3 ) 
interval spectrum becomes 




3(2^9873+1 ; I2020cqs ^-22389cos 2 aAd7 1 Q6cos 3 aA-6^ecos\) 
(169+27 cos 2 u)3983ti 



(8. A. 2 . 16) 
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This completes Example VIII.A.l. However 



reference will be made to this example in the following 
section. Exact results for processes evaluated in this 
manner are tabulated in Figure VIII. A. 11. 

Recall that the order of an ARMA(m,n) process 
is reflected in the degree of the cosine polynomials in the 
spectral representation. In the case of the E(3,3) process, 
the similar process is an ARMA (2,4) process, giving a 
spectrum whose numerator is a cosine polynomial of degree 
and whose denominator is a cosine polynomial of degree 2. 
Note that not every ARMA (2,4) process is similar to the 
E(3,3) process; only the one whose spectrum is given by 
(8. A. 2.16) . 



An important feature of the results tabulated 
in Fig. VIII. A. 13 is their consistency with the degree of 
the similar ARMA processes tabulated in Figure III.C.l. 

VIII. A. 2. b. The FORMAC algegraic manipulation 
preprocessor 

"FORMAC (FORmula HAnipulation Compiler) 
provides... a tool for performing symbolic manipulation 
of mathematical expressions along with the usual 
features of a numerical mathematical language... 
Expressions to be manipulated can contain variables, 
user-defined functions, constants, symbolic constants 
and functions. Expressions can be differentiated, 
evaluated, replaced, compared and parsed. 



1 Raney (1973, PP- i). 
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Figure VIII. A. 11 Algebraic representations as ratios of 
cos to polynomials of the second order interval spectra of 
certain Erlang superposition processes. The expressions 
given for each spectrum are denoted N, D and Q. The 
spectrum, is 



f + (w) = QN/ D 

Those processes marked with an asterisk were computed by 
Lewis, et al. (1973)- 

The computational difficulty associated with this computation 
is illustrated by the resultant formula for the E(^,4) 
interval spectrum. 

These were computed by hand for small k and p, and with 
FORMA C assistance for higher k and p. 

E(2,2) process* (ARMA(1,0) spectrum) 

N = 1 - COS 03 

D = 1 
Q = 1/5 



E(2,3) process* (ARMA(2,1) spectrum) 

N = 121 - ^8 cos w - 9 cos 2 io 
D = 4l - S cos u 
Q = 9/25 

E(2,^) process* {ARMA(3»1) spectrum) 

N = 871 - 502 cos w - 57 cos 2 w - 2*1 cos 3 w 
D = 17 - 8 cos w 
Q = 8/379 

E ( 3 > 2 ) process {ARMA(2,1) spectrum) 

N = 39^2 + 22^1 cos a) + 378 cos 2 u 

D = 65 + 16 cos u) 

Q = V**95 



2 l<t 



Figure VIII. A. 11 (continued) 



E(3»3) process (ARMA(4,2) spectrum} 

N = 249,873 + 142,020 cos a) - 22,389 cos 2 w 
+ 17,496 cos 3 03 + 6 It 8 cos ^ co 
D = 169 + 27 cos 2 u 
Q = 3/3983 

£(4,2) process (ARMA(2,1) spectrum} 

N = 31 - COS 2 Q3 
D = 3 + cos 03 
Q = 256/3495 

E(4,3) process {ARKA( 5,3) spectrum} 

N = 182,141,315,652,508 - 78 , 862 , 095 , 096,808 cos 03 

- 42,822,137,630,712 COS 2 03 + 25,599,977,898,816 COS ^03 
+ 207,765,000 C OS ^ 03 

D = 43,835,592,913 - 19,552,361,549 cos 03 

+ 19,683,026,163 COS 2 03 - 4,100,625 COS 3 03 
Q = 6561/8,913,904 

E(4,4) process (ARMA(8,5) spectrum} 

N = 310,464,417,651,734,009/8 

+ (1/8)11,776,887,383,690,599,849 COS 03 
+ (1/8)25,218,699,913,699,885,013 C O S 2 03 
+ (1/8)21,251,879,278,015,791,883 COS 3 03 

- 1,060,176,380,434,254,459 COS ^03 
+ 426,910,575,503,195,072 C OS 3 03 

+ 544,710,307,072,237,568 COS 6 03 

+ 17,367,184,018,767,872 cos ^03 - 1,090,519,040,000 cos 8 03 
D = 230,024,100,214,001 - 64,640,820,663,704 cos 03 

+ 115,164,588,505,856 C O S 2 03 + 75,974,636,240,896 COS 3 03 
- 8 , 481 , 012 , 711,724 cos ^ o) - 335,554,320,000 cos ? 03 
Q = 1 , 556 , 39 1 , 325 , 136 xl 0 10 / 833 , 625 , 4 50 , 4 72 , 186 , 167 , 743 , 9 l 8 , 50 
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Figure VIII. A. 11 (continued) 



E(5>2) process (ARMA(3,2) spectrum} 

N = 4,0^3,205 - ^ 7,5 5 3 cos u - 22^,126 cos 2 w + 9,728 cos 3 w 
D = 1,17^,529 + 720,192 cos w - 4,096 cos 2 w 
Q = 160/679 
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I 






The above description summarizes the properties 
of FORMAC. The specific capabilities of FORMAC which loaned 



themselves to this phase of the research were 

1. ) Ability to maintain formula integrity. That is, to 

keep track of variables in symbolic form so that 
the contribution of each parameter to the final 
result is directly apparent. 

2. ) Ability to perform polynomial multiplication. 

3. ) The capacity to maintain extensive formulae in exact 

form. Integer coefficients can have up to 2295 
digits, while formula length is only limited by core 
storage available to the program. 

Ij.) The capability of implementing simplifying substitu- 
tions, as for example, the trigonometric identities 
of Appendix B. 

In evaluating expressions of the form shown in 
(8. A. 2. 9) the identity 



cos = cos ( 2 tt j /k ) cos ( w/k) - sin(2iTj/k)sin(w/k) 



was used to isolate the variable terms cos(w/k) and sin(w/k). 
For many values of j and k, there are no rational equivalents 
to cos(2TTj/k) and sin (2mj /k ) . Thus, to ensure that cancel- 
lation of terms, where it occurred, would not be masked by 
numerical imprecision, and conversely, not be indicated by 
very small coefficients, the terms cos(2irj/k) and sin(2iij/k) 
were retained as symbolic entities. 

Equations (8. A. 2. 9) and (8. A. 2. 12) illustrate 
the need for polynomial multiplication. There S,-(cj) is the 
sum of polynomial fractions in sin(w/3) and cos(w/3). Each 
step of the procedure which expresses S^Cw) as a single 
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polynomial fraction requires multiplication of polynomials 
and collection of like terms. At the same time, these 
polynomial products involve many terms in various combina- 
tions of 

sin r ( 2 7 T j /k ) ccs s ( 2vm/k) cos t ( w/k ) sin v ( w/k) ( 8 . A . 2 . 17 ) 

which must be maintained in their entirety until simplifying 
relations can be imposed. 

The method of generating the compact form of the 

spectrum of an S(k,p) process is iterative in nature. It is 

not clear at the outset which trigonometric identities will 

reduce the complicated formulae to the desired form. The 

problem must first be run without substitutions of any kind. 

Based on the results of the preliminary run, a set of 

2 2 

substitutions designed to convert sin^ v (w/k) to ( l-cos^ (to/k) ) v 
and all symbolic coefficients of cos^Cw/k) and sin^ v- "*' ( w/k) 
to rational numbers. (It is not clear that this is always 
possible, but it was worked out for those cases actually 
considered.) The final stage requires the conversion of 
cos t (u/k) to cos(tw/k). At this step, correct formulation, 
correct substitution and Theorem III. A. 2 guarantee the 
cancellation of terms for which t is not an integral 
multiple of k. 

Two serious drawbacks to this procedure exist. 
First, the FORMAC analysis is extremely demanding in terms 
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of computer space and time. A final run for the spectrum of 
the E(5,2) process, once the appropriate substitutions had 
been determined, required 378000 bytes of storage and 73 
minutes of central processing unit time on the IBM 360/67 
computing system. 

The second drawback is in determining the first 
stage substitution requirements and substitution identities. 
As can be seen in (8. A. 2. 17), a great many combinations are 
possible. In the E(5,2) analysis, with 



a^ = cos ( 2tt/5 ) = -cos ( 3tt/5 ) = 
b^ = sin(2iT/5) = sin(3n/5) = 
~ cos(^tt/5) = cos(6tt/5) = 
bg = sin(^iT/5) = - sin(6iT/5) 



cos(7tt/5) = 
sin(7iT/5) = 
cos(9tt/5) = 
- sin(9iT/5) 



cos ( 8ir/5 ) 

- sin(8iT/5) 

- cos(tt/5) 

= sin(ir/5) 



some typical substitutions were 

t ’l b 2 a 2 a l ” b 2 t ’l a l a 2 = “ 5/2^ 
a 2 +a 2 = 3/22 

(a 1 a 2 b 1 b 2 ) 2 = 5/2 8 . 

All of the above forms were derived from the basic identities 

a 1 + a 2 = -1/2 , 

and 2 2 

a l = 2a 2 ~ 1 = 1 ~ 2b 2 • 
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In all, 4l substitutions were required for the 
second stage computations. The number of such substitutions 
increases rapidly with k and p, along with the complexity of 
the terms, the time and the space required for the computations. 
Using this method on a process such as the E(7,3) process is 
virtually impossible. 

VIII. B. THE INTERVAL SPECTRUM OF THE SEMI-MARKOV 
GENERATED POINT PROCESS 

The interval spectrum of a semi-Markov generated point 
process, as shown in Chapter V, (5.B.5) involves the inverse 
of the matrix (Iu-T). In order to form a workable expression 
for the spectrum, a practical method for performing the 
inversion of a matrix containing a variable term is required. 
Three methods have been investigated for this purpose. The 
methods are designated algebraic inversion , diagonalizat ion 
and numerical approximation . 

Subsection VIII. B.l details the method of algebraic 
inversion, by which a modified Gauss elimination written for 
the FORMAC preprocessor was used to find (Iu-T) - "*" directly. 

Subsection VIII. B. 2 describes the use of diagonalizing 
matrices P and P -1 to find 

(Iu-T)" 1 = P ( Iu-D) -1 P -1 
where D=P 1 TP is a diagonal matrix. 
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Subsection VIII. B. 3 contains an explanation of the use 
of equation (5.B.12) to generate a numerical approximation 
of the interval spectrum. In this method, the summation 

00 

I TT T M n (T J_1 -T°°)M,lcos ju 
J=1 1 

= ? tt t M (T J_1 -T*)M T_cos jw 

J-l 

with the error decreasing geometrically with N. 

VTII. B.l Algebraic Inversion of (Iu-T) 

The method of direct algebraic inversion relies on the . 
theory of integer preserving Gaussian elimination. (See 
for example Bareiss (1968)) 

The procedure is this: 

To the matrix (Iu-T), and an identity matrix of the same 
dimension, apply a sequence of identical transformations 
which will transform (Iu-T) to an identity matrix. Then the 
matrix which results from the sequence of transformations 
applied to the identity matrix will be (Iu-T) - ^. In the 
iterative Gaussian procedure, denote the state of the 
original matrix after it has been operated upon n-i times 
by {a^ and the correspondingly transformed identity 

matrix by {b|j - ^}. 

Let d^ n ^=a^”^, n=l,...,m; d^^ = l, where m is the 
nn 

dimension of the matrix T. Then for i^n. 
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(8.B.1.1) 



a 



(n) 

ij 



(a (n- 1 ) a (n, . a (n- 1 ) a (n- 1) 



)/d 



(n-1) 



b 



(n) 

ij 



(b (n- 1 ) d (n) . b ( r 1 ) a (n- 1) 



)/d 



(n-1) 



(8.B.1.2) 



and 




(n-1) 

nj 



(n) _ K (n-1) 
nj 



(8.B.I. 3) 



Two important features of this computation are, 
from Fox (1965, Ch. 3), 

a. The term d^ n- ^ divides the terms of (8.B.1.1) 
and (8.B.1.2) exactly, and 

b. If (Iu-T) is of order m, then d^ m ^ is the 

determinant of (Iu-T), and is the adjoint. That is, 

if B = {b^ ) }, then 



(Iu-T)" 1 = B/d (m) 



(8.B.1.4) 



Although the divisibility property, a, is easily 

(n ) 

verified, it must be remembered that d^ is a polynomial in 
u for n=l,...,m. Initially, we have d^^u-t^, and from 
(8.B.1.1) , 

d*' 2 ^ = ( (u-t 22 ) (u-t 11 )-t 12 t 21 >/l 

Similarly, the terms and b^j^ are polynomials in u. 

It is necessary, therefore to perform polynomial division 
to force each new element into the proper form. 
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A polynomial division algorithm presented by Knuth 

(1969) was used: Let A=a n x n +...+a ,x+a , and let 

u n-l n 

B=b n x m + . . . +b ,x+b m , with m<n. It is desired to find 
0 m-l m — 

\r 

C=CqC + . . . +c^_^x+Cj c =A/B. The result requires n-m+1 
iterations with k=n-m. At iteration j=0,l,...,k, 



where 





a ' 3 1 > -Cjb r , r-J„)+l 



, r>j+m 



. , j+m 



and 

a p 0 ^ = a r , r=0 , . . . ,n . 

This scheme was implemented using the FORMAC 
preprocessor. The special capabilities of FORMAC which 
suited it to this problem were, in additon to those previously 
listed, the expression analysis capabilities. In particular, 

a. The ability to extract coefficients of given terms 
from a given expression, and 

b. The ability to determine the greatest and lowest powers 
of a given term. 

At any point of the inversion that a division A/B 
was required, FORMAC commands determined the degree of A 
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and B as polynomials in u, extracted the coefficients of 
in both expressions, and executed the division algorithm. 

To evaluate this and the other methods listed below, 
several semi-Markov point processes were constructed which 
were equivalent to the Erlang and hyperexponential super- 
positions using the methods detailed in Chapter VI. Of 
interest here are the compact formula for the interval spectra 
as compared to those tabulated in Figure VIII. A. 11, and the 
plots of the hyperexponential superposition spectra shown in 
Figures VIII. B.l and VIII. B. 2. Plots of the Erlang super- 
position spectra from this method are not shown as they are 
identical for small k and p with those produced by the 
numerical routine, SPECD, which is considerably more efficient 
in terms of both time and storage requirements. 

It should be noted at this point that producing the 
exact polynomial form of the E(5,2) process interval spectrum 
required less than two minutes by the algebraic inversion 
method, as distinguished from the 73 minute run using the 
direct computations of Subsection VIII. A. 2. As the 
dimension of the transition matrices increases, numerical 
error seriously interferes with the results. 

VIII. B. 2. The Diagonalization Method 

In this method of matrix inversion, it is necessary 
to find a matrix P such that TP=PD, where D is a diagonal 
matrix. ^ In particular, the matrix D has the eigenvalues 



^This method was suggested by Dr. M. Rosenblatt during 
a visit to the Naval Postgraduate School. 
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Figure VIII. B.l Interval spectra for the H(2,2;q,A_) super- 
position process; A^.l, q^=.l,.3,.5; A 2 =1 _ ^i> These 

spectra were obtained from the semi-Markov generated point 
process representation of the H(2,2;q,A.) process.. Note that 
the sharpest peak results from the process in which the 
dominant exponential component has the highest intensity. 

The coefficient of variation refers to the superposition 
interval . 
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Figure VIII. B. 2 Interval spectra for the H(2,2;q super- 
position process q, = .l, A, = . 1 , .25 , • 9 , A 2 = l-A-^. Construction 

of this graph as in Figure VII.B.l. Note that with the 
dominant component in the hyperexponential distribution 
having a slow rate, A 2 =.l the spectrum is nearly flat. 
Comparison with Fig. VIII. B.l indicates that the spectral 
density is not closely related to the coefficient of variation. 
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of the matrix T as its diagonal elements. The matrix P may 
be made up of linearly independent representations of the 
right eigenvectors associated with the eigenvalues of T. 

Then 

T = PDP -1 

so that 

( Iu-T) -1 = ( PP -1 u-PDP -1 ) -1 

= P ( Iu-D) -1 P -1 . (8.B.2.1) 

Clearly, (Iu-D) is a diagonal matrix with elements 
u-X i , where X^ = d^ is the ' i-th eigenvalue of T, so the 
inverse can be written directly as 

(Iu-D) -1 = (6 .(u-X ) -1 } (8.B.2.2) 

-L J 

where 6.., is the Kroneker delta. 

Referrring to (5.B.5), 

f + (u) = 7 t t {M 2 +M 1 [(Iu( U )-T) -1 +(Iu(-u)-T) _1 ]M 1 }1 

= tt t {M 2 +M 1 P[(Iu(w)-D)“ 1 +(Iu(-w)-D)“ 1 ]P _1 M 1 }1 , 

where u(s) = exp{-is), with i = \J -1 . 



227 



Substituting from (8.B.2.2), 



(Iu(w)-D)" 1 + (Iu(-w)-D)" 1 



= {6 i j (u(w)-Xj ) -1 + (u(-w)-Xj } 
= {26^.(cos to-Aj ) /( l-2Aj cos u+Aj)} 



(8.B.2.4) 



It is a simple matter to complete the analysis 
using a FORMAC program. 

Actual computation of D, P and made use of the 

IBM Scientific Subroutine Package (SSP- 36 O) routines DEIGENP 
and CMTRIN, the latter modified to perform double precision 
arithmetic. DEIGENP is a program which computes the eigen- 
values and eigenvectors of a general real matrix by means 
of the Q-R method. (See for example Stewart, 1973). 

CMTRIN computes the inverse of a complex matrix by the 
method of Gaussian elimination. 

This method worked very successfully with small test 
matrices, such as that of the semi-Markov generated point 
process equivalent to the E(5>2) process which had dimension 
5 and real eigenvectors and eigenvalues. On larger matrices, 
such as the semi-Markov generated point process equivalent 
to the E(5,3) process which has dimension 15, the numerical 
errors grew to the point that meaningful analysis was 
impossible. It is possible that some error reduction 
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techniques might be applied which would render this method 

useful for larger matrices. 

No effort was made to determine if, in general, the- 

stochastic transition matrices considered here are 

diagonalizable . It was assumed that such a procedure was 

feasible, presuming that if the assumption were false, it 

would be indicated by the numerical results. 

VIII. B. 3- The Interval Spectrum by Numerical 
Approximation 

The definition of the interval spectrum of a semi- 
Markov generated point process, given by 5.B.12) is 

f.(w) = {1+-% 2 tt t M (T j ' 1 -T c °)M n lcos jco}/iT . ( 8 .B. 3 .I) 

o j = l 1 

From (5.B.15), it is known that converges geometrically 
to T , as j grows large. Let br J " _> max{ 1 1 | } , for 

some 0<r<l. (The existence of b and r are shown by Kemeny 
and Snell, I960). Then 

OO 

| I tt t M (T^" 1 _T co )M 1| < ! T M^Tb I r J 
j=N+l 1 11 j=N+l 

< u T M^lbr N_1 /(l-r) . (8.B.3.2) 

That is, the truncation of the summation in ( 8 .B. 3 .I) at 
j“N has error bounded by the right hand side of (8.B.3-2). 
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The method of numerical approximation outlined here 1 



is computationally the most efficient means of generating 
spectral values. It has the side benefit of providing the 
first N serial covariances directly. 

VIII. C. THE ARBITRARY INTERVAL DENSITY OF THE E(k,p) PROCESS 
In Chapter VII, a computational form for the density of 
an arbitrary interval of an E(k,p) process was given ( 7 .B. 6 ), 
with the product of two Erlang density functions given by 



Evaluation of (7.B.6) made use of two properties of 
FORMAC not previously mentioned. First is the capability to 



property is the ability to manipulate functions in symbolic 
form. For example, H ( J ,n) is defined by 



Then equation (7.B.6) can be evaluted in terms of H(j,n), 
performing the operations indicated in (7.B.5) at each step. 
The right hand side of (8.C.1) can be substituted into the 
final form for numerical evaluation of the arbitrary interval 
pdf, or the expression can be examined as a linear combina- 
tion of Erlang densities, H(j,n). The representation in 



^Suggested by Professor W. M. Raike of the Naval 
Postgraduate School. 



(7.B.5) . 



evaluate combinatorial expressions such 




H(j,n) = (nA)^x J ' -1 exp{-nAx}/{ ( j — 1 ) ! } 



(8.C.1) 
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which the function H(j,n) was replaced with the Erlang pdf 
was used to generate the comparative plots shown in Figures 
VIII. C.l through VIII. C. 4. 

Two features of the plots are worth special note. The 
first is that the initial points are in agreement with the 
result stated as Theorem VII. A. 1. That is, for the 
arbitrary interval density of an E(k,p) superposition process 
with A=k/p the initial point is 

f£ p) (0+) = (p-l)/p . (8.C.2) 

A second point is that regardless of the parameters of 
the case, each arbitrary interval density is unimodal . 

While it has not been proven that this holds generally for 
all k and p, it may be conjectured that this is the case. 

It is interesting, and perhaps counter-intuitive, that 
the distinct shape of the Erlang density functions tends to 
be retained more with k=2 than with higher values of k. In 
any event, the special shape is no longer apparent for k>4, 
and the superposition pdf looks much like the exponential. 

Because the final form of the density is a convex linear 
combination of Erlang densities, expectation, variance and 
coefficient of variation can be obtained directly from the 
moments of the component distributions without integration. 
Equation ( 3 * E . 8 ) gave the initial value of the spectrum of 
counts which can be combined with the expectation and 



f(t) 




Figure VIII. C.l Arbitrary interval densities for E(2,p) 
superposition processes, p=2,...,8. All distributions 
normalized to unit mean ( A=k/p ) . The squares represent a 
unit exponential pdf. The diamonds trace a y^(2,2) pdf. 

The initial points are (p-l)/p for each curve. This figure 
illustrates the dependence on p as the pdf curves rapidly 
lose the distinctive Erlang shape and approach the 
exponential curve. 



232 




Figure VIII. C. 2 Arbitrary interval densities 'for E(3,p) 

superposition processes. Squares, diamonds and normalization 
as in Figure VIII. C.l. With k=3> the distinctive shape of 
the Erlang pdf fades more rapidly with increased p than 
for k=2. The trend continues with larger k, so that by 
k=5, p=3 the pdf looks exponential. 
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Figure VIII. C. 3 Arbitrary interval densities for E(k,2) 
superposition processes, k=2,...,8. The squares denote a 
unit exponential pdf. The arbitrary interval pdf's are 
normalized to A=k/p. While each curve has the common 
Initial value of 1/2, the maximum values diminish and are 
more distant from the origin as the densities seem to be 
taking on a rectangular form with increasing k. 



2 3 ^ 




Figure VIII. C. 4 Arbitrary interval densities for E(k,3) 
superposition process, k=2,...,6 normalization as in 
Fig. VIII. C. 3. Here the node associated with the Erlang 
pdf has virtually disappeared for k>2. When p is increased 
beyond 3, the pdf's of the various processes are nearly 
indistinguishable, differing only slightly from the 
exponential . 
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.1194A 
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.0265A 
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Figure VIII. C. 5 Data derived from E(k>p) pdf analyses. 
Observe that C^(x) decreases with k and increases with p, 
while f + ( 0 +) decreases with increase in either k or p . 
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coefficient of variation as in (7.B.11) to provide the value 
of the initial point of the interval spectrum. 

The quantities thus obtained were used to verify those 
obtained through spectral analysis. In each case, positive 
verification was achieved. 

A summary of the key values related to pdf analysis for 
certain E(k,p) processes are tabulated in Figure VIII. C. 5. 

VIII. D. NUMERICAL REPRESENTATION OF THE INTERVAL BISPECTRUM 
OF A SEMI-MARKOV GENERATED POINT PROCESS 

In Chapter V, Section C, the procedure for generating 
higher order spectra was outlined, with a specific form 
given for the interval bispectrum of a semi-Markov generated 
point process (5.C.10). Evaluation of (5.C.10) hinges, as 
with the interval spectrum, on the matrix (Iu-T) -1 , as in 
Section B of this chapter. For this reason, any of the 
treatments of Section VIII. B may be applied to this problem. 
For purposes of illustration, the numerical approximation 
method (VIII. B. 3) was selected to evaluate and plot the 
bispectrum of intervals in the E(5,2), E(5,3) and E(3,5) 
processes from their semi-Markov generated point process 
representation . 

The results of this procedure are illustrated in Figures 
VIII. D.l through VIII. D. 6. It will be recalled from 
Section V.C that the bispectrum may be defined on any one 
of twelve sectors of the real plane. The examples illustrated 
in this section are shown in the sector defined by • 
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Two views are shown of each bispectru, the first is the 
view from the positive quadrant back toward the origin. 

The second view is from the negative quadrant looking over 
the positive quadrant. 

Since the bispectrum is a complex valued function, it 
was decided to plot the absolute value of each point. Also, 
the bispectral values were scaled by a factor of 10 to 
exagerate the surface shape. With the scale for all axes 
the same, the absolute bispectrum looks almost flat, a 
matter of some concern if the bispectrum of some data is to 
be estimated. 

VIII. E. INTERVAL SERIAL CORRELATION COEFFICIENTS 

In a mixed autoregressive/moving average process of 
orders m and n respectively, it was noted in Section III.E 
that the serial correlation coefficients for lags greater 
than n can be expressed as 

p k = a l p k-l + + a m p k-m J k>n (8.E.1) 

A major portion of model identification analysis 
involves determining n, m and {a.} from the sequence of 

J 

serial correlation estimates (Box and Jenkins ( 1970 )) . 

Where n and m and { p ^ } are known, the coefficients a^ , can 
be determined from the linear system 
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(0,7T, 




Figure VIII. D.l 

Absolute bispectrum of the E(5,2) interval process. This 
and Fig. VIII. D. 2 are isometric projections of the E(5,2) 
bispectrum. Only one octant is shov/n as the values are 
reflected in the adjacent octant. Interpretation of this 
type of representation remains an open question. Construction 
of this and the follov/ing bispectral representations was by 
method of approximation. 
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Figure VIII. D. 2 
Absolute bispectrum of the E(5,2) interval 
process (Reverse view). This is a view of 
the E(5,2) absolute bispectrum of intervals 
looking toward the origin from the first quadrant 



2*40 



(0,0, .647) 



(ir,TT, .23) 



( 




P A’?, A , h 



j.M 

,\\\wk'A|) 



-J ' 



(0 ,TT, 0) 







:ii 



( 

!«r 






1 



Jit. 

ii ini 

h 

1 1 



(0,0, c 



Figure VIII. D. 3 Absolute bispectrum of intervals of the 
E(5,3) process. This and Figure VIII. D. 4 represent the 
absolute bispectrum of the E(5,3) process. The jagged 
appearance may be due in part to the course grid used 
in the plot (40 x 40) . 
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Figure VIII. D. 4 Absolute bispectrum of intervals for the 
E(5,3) process (reverse view). This is a view of the E(5,3) 
absolute bispectrum looking back to 'ward the origin from the 
first quadrant. Note that the magnitude of the peaks is 
about 10 times that of the E(5,2) process. 
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(71,71,0) 



(0,77,0) 




Figure VIII. D. 5 

Absolute bispectrum of intervals of the 
E ( 3 > 5 ) process. This and Figure VIII. D. 6 
are isometric projections of the E(3>5) 
absolute interval bispectrum. Mote the 
relatively flat appearance, nearly vanishing 
at the origin. This is similar to the second 
order spectrum which flattens with increased p 
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Figure VIII. D. 6 Absolute bispectrum of the E(3,5) interval 
process (reverse view). Observe that the surface is 
slightly wavey with the highest peak at (ir/2 , tt/2 ) , with 
secondary peaks at ( 3^/^ , 3^/^ ) , (tt,tt/2) and (t t , 3 7T / i O - 
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If the actual order of the process is (m’,n'), the 
following result is obtained from solution of the system 
given by ( 8 . E . 2 ) : 

n’<n and m>m' : The matrix of correlation coefficients 

will be singular 

n’>n or m'>m : Equation (8.E.1) will not be satisfied 

for k>n+m using the coefficients 
derived from (8.E.2). 

This idea leads to a procedure for verification of the 
results of Section III.D wherein a method is presented for 
determining the order of the polynomials which make up the 
interval spectrum of an E(k,p) process. 

When the process being studied has been given an 
equivalent semi-Markov generated point process representation, 
the serial coefficients may be obtained directly form (5-3.3) 
and (5.B.1J) 'which give the covariance and variance as 
functions of powers of the transition matrix, T. If only a 
spectral representation Is available, as for example output 

2^5 



of SPECD (Subsection VIII.A.l), the spectrum must be inverted 
to produce the serial correlation coefficients. 

Recall from (2.A.3.3) that 



f.(uj) = {1 + 2 Z p.cos joj} /Tt , 0 < to < tt . (8.E.3) 

J=1 J 

The inverse relation (see for example Cox and Lewis (1966, 

Ch. 4)) is 

tt' 



p. = / f (w) cos j to dco 
J 0 



(8.E.4) 



A discrete approximation of (8.E.3) 



N 



f, (w ) = {1 + 2 Z TT. cos j to } 
n j=l J n 



/tt , (8.E.5) 



where oj = mn/N, n=0,....N-l. The inverse relation of 
n )i 3 



(8.E.5) is 



p, = tt I f +( u n ) cos > j = 0,l, . . . ,N-1 . 

J n=0 n n 

(8.E.6) 



N-l 



where tt/N represents the separation betv;een w and w , , . 

n n+1 

The equations (8.E.5) and (8.E.6) represent a finite 
Fourier transform pair, v/ith communication between the two 
representations easily handled by the Fast Fourier Transform 
Algorithm (See for example Cooley, Lewis and Welch (1967))- 



The key property of the finite Fourier transform which is 

the basis for the fast Fourier transform is that the transform 

of a sequence of N=2 n points can be written as the sum of n 

transforms of lengths 2, 2, 2 2 , 2^,..., 2 n_1 . Since each 

? 

transform of length r requires approximately r operations, 

the number of steps required by the fast Fourier transform 

is nN=Nlog 2 N as compared with an N point transform requiring 
2 

N operations. 

The program package FORT/RFORT supplied by IBM was used 
in this analysis. Figure VIII. E.l is a comparison of the 
E(8,2) process correlation structure as determined by SPECD, 
FORT/RFORT, and as determined by the approximation method 
applied to the semi -Markov representation of this process. 

The parameter k=8 accentuates the differences in the 
procedures which are indistinguishable for smaller k. 

The correlation structure of additional processes is 
tabulated in Appendix D. 

VIII. F. COUNT SPECTRA OF THE E(k,p) PROCESS 

The second order count spectrum of an E(k,p) process is 
given by (3-0.6). Direct numerical evaluation of this form 
for various values of k is shown in Figure VIII.F.l. Because 
the count spectrum is linear in p, a value of p=l has been 
used for all computations. Two features are rea'dily 
apparent from inspection of Figure VIII.F.l. The first is 
that for small k after the initial fluctuation the spectrum 
of counts converges rapidly to 1/m. This fact is readily 
verified by taking the limit w-*- 00 in Equation (3- 0.7). 
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Figure VIII. E.l Comparison of SPECD and the approximation 
method of spectral representation. 

The accuracy and efficiency of two methods used for 
numerical approximation of the interval second order spectrum • 
of the E(k,p) process are compared for the E(8,2) process. 

Method 1 . Numerical approximation of the spectrum using 
SPECD (VIII. A. 1). Fast Fourier transform of 
spectrum to determine correlations and damping 
coefficients (32,768 and 4096 point approximations) 

Method 2 . Numerical approximation of the equivalent semi- 
Markov generated point process (VIII.B.3) 







METHOD 1 




METHOD 2 


Number of points 


32,768 


4096 


200 


CPU Time 




8 min 


1 min 


6 sec 


Core 




448K 


202K 


24 8K 


Spectrum 




Same 


Same 


Same 


Correlations : 


1 


-0.52122 


-0.52123 


-0.52123265925713 




2 


0.28153 


0.28154 


0.28153949321523 




3 


-0.14812 


-0.14812 


-0.14813039868207 




4 


0.078694 


0.078695 


0.078699294631380 


Coefficients 


± 


-0.0091941 


-0.011426 


0.000015258401560525 




2 


0.13558 


0.16640 


0 . 0329589905^9093 




3 


-0.24262 


-0.17664 


-0.46874996699262 


Error 




10~ 6 


10" 5 


io“ 1J 



The differences in precision between Methods 1 and 2 
lie in the fact that only single precision results are 
returned from SPECD and FORT/RFORT although double precision 
arithmetic is used in both programs. 

•The E(8,2) case accentuates differences. In those cases 
for which the spectrum has a flatter appearance, the damping 
coefficients are nearly the same from either method. 

The error is based on the comparisons 

p . -,:p = p a., + ... + p ...a 

n+1 n+1 n 1 n-m+1 n 

and 

p ,-,:p = p .-.CL.. + ... + p , 

n+2 n+2 n+1 1 n-m+2 m 
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The second observation from Figure VIII. F.l is that 
the count spectra doe not exhibit the strong dependence on 
k observable in the interval spectra. 
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APPENDIX A NOTATION 



1. General Forms 



F(x), F x (x): 


probability distribution functions 


R(x) , R (x) : 

A 


survivor functions 


Z(x) : 


equilibrium excess (forward recurrence 
time) distribution 


f ( x ) j f x (x): 


probability density functions 


E(- ), Var ( • ) : 


expected value and variance 


o(h) : 


a function that vanishes more rapidly 
than h 


C ( • ) : 


coefficient of variation 



2. Conventions 



Superscript *: 


Laplace transform 



Superscript (p): The superscripted symbol refers to a 

superposition point process 



X ’V 


scale parameters of Erlang and hyper- 
exponential distributions 


y : 


the expected value of an interval in a 
renewal process, or an arbitrary interval 
in a stationary point process 


o 2 : 


the variance of an interval in a renewal 
process, or an arbitrary interval in a 
stationary point process 


Id : 


the largest integer less than or equal 

to X 


lid : 


independent, identically distributed; 
refers to either random variables or 
component processes in a superposition 



Script upper case letters: sets; vectors 

Script lower case letters: sets, vectors 
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Underlined lower case letters: vectors 

Gothic, upper case letters: matrices 

Reserved symbols: Unless otherwise specifically noted, 

k is the shape parameter of an Erlang 
distribution; p is the number of 
components in a superposition 



3 . 



Point Process 
N(t) : 

N f (t) : 

{ V : 

{W,L 1} L 2 ,. 
M(t) : 
m( t ) ,m: 

M f (t): 
m„(t ) : 

V(t) : 
y( x) : 



Notation 

asynchronous counting process (II. A. 1) 

synchronous counting process (II. A. 1) 

synchronous interval process (II. A. 1) 

asynchronous interval process (II. A. 1) 

asynchronous mean-time curve (2. A. 2. 2) 

asynchronous intensity (2. A. 2. 5) 

synchronous mean-time curve (2. A. 2.4) 

synchronous intensity (2. A. 2. 6) 

variance-time curve (2. A. 2. 3) 

covariance density of the counting process 

(2. A. 2. 10) 



g + (w) : 
<f>( z, t ) : 

V“ >: 



second order spectrum of counts ( 2 . A. 2 . 13 ) 

generating function of the asynchronous 
counting process (2. A. 3.4) 

second order spectrum of counts (2.A.3.3) 

serial correlation sequence (2.A.3.7) 



4. Semi-Markov Generated Point Process Notation 
T = (t^j } : Transition matrix (V.A) 

F(u) = (f 1 j(u)}: transition time pdf matrix (V.A) 

( -p *r> 

E = {y.;.'} = {E S. , }: matrix of r-th transition time 

r ^ ^ moments (V.A) 
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it: 

G(u) = 

M = {t 
r 

T”: 
Y(j): 
t(J ,k) : 



stationary vector associated with 
(5. A. l.ll) 

{t..f. . (u)}: weighted transition time pdf 

1J 1J matrix (V.B) 

ij^ij^ ): we ^Shted r-th moment matrix (V.B) 

the steady state transition matrix (5.B.2) 

interval covariance of j lags (5.B.9) 

interval trivariance of j and k lags 
(5.C.1) 



* 

t (a ,b ) : 
* 

t (a) : 
T*(a): 



Laplace transform of r(j,k), 0 < j < k 
(5.C.15) 

Laplace transform of 0 < j 

(5.C.10) 

Laplace transform of t(o,j), 0 < j 
(5.C.17) 



a :b : 

b (u 1 ,u > 2 ) : 



transition from state a to b 
the bispectrum of intervals 



5. Special Notation 



E(k,p) : 



the superposition of p iid k-Erlang 
renewal processes (II. A. 5) 



H (k ,p ;q , X.) : 



ARMA(m,n) : 



a 7 ,b 



the superposition of p iid hyperexponent ia 
processes with parameter vector X and 
probability mass function q. (II. A. 5) 

an autoregressive/moving average process 
of degrees m and n respectively (I.F.l) 

individual terms in the E(k,p) interval 
spectrum ( 3 . A. 1 . 23 ) 



a . ,b . , c . : individual terms in the E(k,p) interval 

spectrum: revised index (3- A. 2. 3) 

V^^^(p): special index set for the E(k,p) interval 

spectrum - k even ( 3 - C . 3 ) 



Y t (k,X) : 



the k-Erlang pdf (2. A. 5.1) 
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APPENDIX B: COSINE CONVERSION FORMULA 



1 . 



Convert cos to to 



k 

I a, .cos jto 
j = 0 KJ 



2~^(cx^Q+a^2 cos 2to+a^cos 4aH- . . . +a^cos kto) , k even 



k 

cos to = 



,-k 



2 (a^cos to+a^^cos 3w+* • .+0^005 kto) , k odd 



; k0 


a k-l , 1 


k=2 , 4 , 6 ,. . . 


: kl 


2a k-l,0 + 


2 5 k~ 3 , 5 , • • • 


; kn 


a k-l,n-l + 


a k-l,n+l 5 n=2j3)1 * * ,k 


'nk 


1 , k=l. 


2 , 3 , 4 ,... 


; 10 


a 01 = 1 





k 

2. Convert cos kto to E a. cos'- 1 to (Tschebysheff Polynomials) 

j=0 J 

cos Ooo = 1 
cos lto = cos to 

cos kto = 2cos to cos{(k-l)cj) - cos{ (k-2 )to} , k=3,4,5 
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APPENDIX C 



Transition probability matrix of the semi-Markov generated 
point process equivalent to the E(2,3) process 




1 iJ 2 




Transition density shape parameter matrix of the semi-Markov 
point process equivalent to the E(2,3) process 



2 3 ^ 

12 3 

\o 1 2 
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Transition probability matrix of the semi-Markov generated 
point process equivalent to the E(2, it) process 
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Transition probability matrix of the semi-Markov generated 
point process equivalent to the E(2,5) process 




Transition density shape parameter matrix of the semi-Markov 
point process equivalent to the E(2,5) process 



2 3^56 

12 3^5 



0 12 
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0 0 1 2 

[0 0 0 1 
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2 
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Transition probability matrix of the semi-Markov generated 
point process equivalent to the E(3,2) process 
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Transition density shape parameter matrix of the semi-Markov 
point process equivalent to the E(3j2) process 



3^5 



2 



3 



4 



.1 



2 



3 



258 



Transition probability matrix of the semi-Markov generated 
point process equivalent to the E ( 3 > 3 ) process 
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Transition density shape parameter matrix of the semi-Markov 
point process equivalent to the E(3,3) process 
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Transition probability matrix of the semi-Markov generated point process 
equivalent to the E(3,5) process 
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Transition density shape parameter matrix of the semi-Markov point process 
equivalent to the E(3,5) process 
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Transition probability matrix of the semi-Markov generated 
point process equivalent to the E(5»2) process 
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Transition density shape parameter matrix of the 
point process equivalent to the E(5,2) process 
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Transition probability matrix of the semi-Markov generated point process 
equivalent to the E(5,3) process 
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Transition density shape parameter matrix of the semi-Markov point process 
equivalent to the E(5,3) process 
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Transition probability matrix of the semi-Markov 
point process equivalent to the E(8,2) process 




Transition density shape parameter matrix of the 
point process equivalent to the E(8,2) process 
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APPENDIX D 



Serial correlations, {pj}^^ and damping factors 



for selected E(k,p) processes. Each E(k,p) process has a 
similar ARMA(m,n) process, with m and n estimated in 
Figure III.C.l. For indices greater than n, the serial 
correlation is given by 



Those processes marked with a single asterisk had 
correlations computed from their semi-Markov generated 
point process representation using (5.B.3) and (5.B.4). 
Correlations for the remaining processes were determined 
from a fast Fourier transform of the interval spectrum as 
determined by SPECD. (VIII. A. 1 and VIII. E) 

Processes marked with a double asterisk have parameters 
m or n less than indicated in Figure III.C.l. 

Process: E(2,2) Similar Process :ARMA(0, 1) 
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Process: E(2,3)* 



Similar Process: ARMA(1,2) 
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Process : 



Similar Process: ARMA(2,*0 
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Process: E(4,4) 
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0.12700 
-0.02400 
-0.01846 
0.01257 
-0.00084 


1 0.02899 

2 -0.43110 

3 -0.01320 

4 -0.02046 

5 -0.80478 

6 -0.04981 


-0.00245 


| £ | < 10 -6 


E(8,2)* 


Similar Process: ARMA(3,4) 


P _1 


i 


-0.52123 

0.28153 

-0.14813 

-0.07870 


1 0.00001526 

2 0.03296 

3 -0.46875 

lei < 10" 14 
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M t ( 3 , 2 ) = M i ( i , 2 ) / ( 1 . -R ) 
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L ET ( U= X + A ( I . I ) 
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LET(S=LGWP0W( A(h»N ) ,X) ) 

T X P = iGTcGtRlS ) 

I F 1,-JFaP. GT .MXP ) N E X P = N T X P 
if- UjEXP .LE .0 iGu TO 61 
LET ( r, EX P= ’ wEXP • ) 
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U L = V l. ( J ) 
UH = VR ( J ) 
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SUBROUTINE CVLMLT ( A , B » C » N , NO ) 

CVLMLT BCKMS THE LEFT HAND PRODUCT OF THE VECTOR A WITH THE MATRIX 
COMPLEX* 16 A(16),B(16»16),C<16) 
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